Jul 05 04:23:25.529906 np0000004568 systemd[1]: Started devstack@c-bak.service - Devstack devstack@c-bak.service. Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: we strongly recommend against using it for new projects. Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: If you are already using Eventlet, we recommend migrating to a different Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: framework. For more detail see Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 04:23:25.663199 np0000004568 cinder-backup[101263]: import eventlet # noqa Jul 05 04:23:26.716962 np0000004568 cinder-backup[101263]: INFO cinder.cmd.backup [-] Backup running in single process mode. Jul 05 04:23:26.832323 np0000004568 cinder-backup[101263]: INFO dbcounter [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Registered counter for database cinder Jul 05 04:23:26.876511 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:23:26.961186 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writer thread running {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 04:23:26.964418 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 05 04:23:26.966696 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Jul 05 04:23:26.968829 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 04:23:26.970585 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 04:23:26.973186 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 04:23:26.975076 np0000004568 cinder-backup[101263]: INFO cinder.rpc [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 04:23:27.023182 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:23:27.036875 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Acquiring lock "singleton_lock" {{(pid=101263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 04:23:27.036977 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Acquired lock "singleton_lock" {{(pid=101263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 04:23:27.037177 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Releasing lock "singleton_lock" {{(pid=101263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 04:23:27.037362 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ******************************************************************************** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 04:23:27.037457 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Configuration options gathered from: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 04:23:27.037551 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 04:23:27.037727 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 04:23:27.037938 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ================================================================================ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 04:23:27.038101 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allow_availability_zone_fallback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038212 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allow_compression_on_image_upload = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038332 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allowed_direct_url_schemes = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038441 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] api_rate_limit = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038558 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] auth_strategy = keystone {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038678 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backdoor_port = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038791 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backdoor_socket = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.038904 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039025 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_api_class = cinder.backup.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039142 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_compression_algorithm = zlib {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039250 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_create_containers = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039363 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039471 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver_init_check_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver_stats_polling_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039727 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039855 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_max_operations = 15 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.039964 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_metadata_version = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040074 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_name_template = backup-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040178 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_native_threads_pool_size = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040282 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_object_number_per_notification = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040388 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_service_inithost_offload = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040496 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth = per_user {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040617 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040744 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_url = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040866 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.040972 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_block_size = 32768 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041086 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041193 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_container = volumebackups {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041296 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_create_storage_policy = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041406 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_enable_progress_timer = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041504 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_key = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041623 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_object_size = 52428800 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041751 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_project = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041870 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_project_domain = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.041975 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042079 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_retry_attempts = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042185 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_retry_backoff = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042291 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_service_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042400 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_tenant = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042640 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_url = https://10.4.3.20:8080/v1/AUTH_ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042803 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.042922 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_user_domain = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043032 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_timer_interval = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043139 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_use_same_host = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043244 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_use_temp_snapshot = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043351 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_workers = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043463 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chap_password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043587 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chap_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043724 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043856 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_internal_tenant_project_id = 521254754d5040259c9b45bfb6d9314d {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.043962 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_internal_tenant_user_id = 6604ccce5c3a4624aeba9a3a5aed3d26 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044072 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] compression_format = gzip {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044182 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_dir = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044270 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044376 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_source = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044491 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044622 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] control_exchange = openstack {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044747 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] debug = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044864 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.044969 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_group_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045119 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045234 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_volume_type = storpool {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045329 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] disk_geometry = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045431 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_client_cert = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045533 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_client_cert_key = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045648 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_data_namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045783 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_ssl_cert_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.045999 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_ssl_cert_verify = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046077 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046175 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enable_new_services = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046279 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enable_unsupported_driver = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046392 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enabled_backends = ['storpool'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046495 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enforce_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046613 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] filter_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046746 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046868 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_servers = ['https://10.4.3.20/image'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.046972 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_ssl_compression = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047080 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047188 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_catalog_info = image:glance:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047290 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047419 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047514 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047639 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_num_retries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047764 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_request_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047881 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] goodness_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.047993 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] graceful_shutdown_timeout = 5 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048103 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] group_api_class = cinder.group.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048209 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] host = np0000004568 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048315 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_compress_on_upload = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048423 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_address_space_limit = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048529 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_cpu_limit = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048704 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048820 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_disable = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.048925 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_upload_use_cinder_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049026 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_upload_use_internal_tenant = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049128 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049229 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_max_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049337 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_max_size_gb = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049441 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] instance_format = [instance: %(uuid)s] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049546 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049679 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iscsi_target_flags = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iscsi_write_cache = on {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.049922 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050079 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050193 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050300 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050409 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050520 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_color = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050654 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_config_append = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050797 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.050905 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_dir = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051011 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051115 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_options = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051221 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotate_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051334 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotate_interval_type = days {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051439 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotation_type = none {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051526 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051630 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051783 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051903 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.051990 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052098 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_age = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052199 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_logfile_count = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052302 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_logfile_size_mb = 200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052416 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_over_subscription_ratio = 20.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052519 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] message_reap_interval = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052644 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] message_ttl = 2592000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052770 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] monkey_patch = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052887 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] monkey_patch_modules = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.052993 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] my_ip = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053098 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] no_snapshot_gb_quota = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053229 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_iser_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053336 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_shell_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053440 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_volume_device_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053541 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmeof_conn_info_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053670 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmet_ns_id = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053796 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmet_port_id = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.053908 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_max_limit = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054020 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_ext_list = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054133 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054241 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_listen = 0.0.0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054345 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_listen_port = 8776 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054448 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054547 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_workers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054676 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] per_volume_size_limit = -1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054797 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] periodic_fuzzy_delay = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.054901 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] periodic_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055009 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] project_id_regex = [0-9a-f\-]+ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055113 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] public_endpoint = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055240 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] publish_errors = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055345 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_backup_gigabytes = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055457 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_backups = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055565 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055702 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_gigabytes = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055829 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_groups = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.055934 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_snapshots = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056045 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_volumes = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056145 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_burst = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056251 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_except_level = CRITICAL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056354 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_interval = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056458 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] replication_device = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056564 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] report_discard_supported = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056708 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] report_interval = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056862 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reservation_clean_interval = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.056949 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reservation_expire = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057056 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reserved_image_namespaces = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057183 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reserved_percentage = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057295 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057409 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057521 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rpc_response_timeout = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057639 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] run_external_periodic_tasks = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057787 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.057900 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scst_target_driver = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058004 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scst_target_iqn_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058111 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_down_time = 720 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058215 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] shell_completion = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058322 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] snapshot_name_template = snapshot-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058423 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058506 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] state_path = /opt/stack/data/cinder {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058635 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] storage_availability_zone = nova {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058741 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] storage_protocol = iSCSI {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058856 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.058963 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] syslog_log_facility = LOG_USER {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059069 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_helper = lioadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059236 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059344 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059459 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059563 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_protocol = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059691 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_secondary_ip_addresses = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059808 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] trace_flags = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.059918 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] transfer_api_class = cinder.transfer.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060033 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] transport_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060131 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] until_refresh = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060232 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_chap_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060341 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_default_quota_class = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060441 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_journal = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060544 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_json = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060783 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_stderr = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060886 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_syslog = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.060995 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] verify_glance_signatures = enabled {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061108 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061241 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_api_class = cinder.volume.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061346 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_backend_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061457 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear = zero {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061559 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear_ionice = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061685 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear_size = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061802 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.061908 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_copy_bps_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062016 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_dd_blocksize = 1M {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062117 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062221 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_name_template = volume-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062325 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_usage_audit_period = month {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062456 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.062582 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_concurrency.disable_process_locking = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.062709 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.062892 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063004 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063117 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063249 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063358 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063465 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063710 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063843 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.063959 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064066 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_version = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064167 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.cache = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064279 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064384 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064489 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.delay_auth_decision = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064614 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064719 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.http_connect_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064835 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.064940 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.include_service_catalog = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065044 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065177 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.interface = public {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065288 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065401 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_password = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065500 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065622 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065728 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065843 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.065947 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066056 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066153 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066263 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066362 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066464 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066576 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066689 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.066804 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_token_roles_required = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068608 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.token_cache_time = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.20/identity {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend = dogpile.cache.null {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend_argument = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068812 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend_expiration_time = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.068930 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.config_prefix = cache.oslo {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069007 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.debug_cache_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069162 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enable_retry_client = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069315 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enable_socket_keepalive = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069469 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069643 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.expiration_time = 600 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069825 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.069984 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_retry_attempts = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070145 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070298 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_dead_retry = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070462 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070622 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070789 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_maxsize = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.070950 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071098 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_sasl_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071267 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071415 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071544 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.proxies = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071709 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_db = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.071862 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_sentinel_service_name = mymaster {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072142 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_server = localhost:6379 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072277 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.retry_attempts = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072414 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.retry_delay = 0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072549 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_count = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072712 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_idle = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072793 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.072912 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_timeout = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073018 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_allowed_ciphers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073119 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073222 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073327 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073425 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073528 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.username = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073675 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] coordination.backend_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073796 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.asyncio_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.073904 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.asyncio_slave_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.backend = sqlalchemy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_debug = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_parameters = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_recycle_time = 3600 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_trace = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076583 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_inc_retry_interval = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_max_retries = 20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_max_retry_interval = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_retry_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_overflow = 50 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_pool_size = 5 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_retries = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.076765 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.mysql_wsrep_sync_wait = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.pool_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.retry_interval = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.slave_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.sqlite_synchronous = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.synchronous_reader = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077008 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.use_db_reconnect = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.connection_string = messaging:// {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077160 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077327 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_doc_type = notification {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077327 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_scroll_size = 10000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077327 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_scroll_time = 2m {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077327 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.filter_error_trace = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077438 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.hmac_keys = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077466 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.sentinel_service_name = mymaster {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077582 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.socket_timeout = 0.1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077707 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.trace_requests = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077827 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.trace_sqlalchemy = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.077938 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_jaeger.process_tags = {} {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078046 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_jaeger.service_name_prefix = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078146 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_otlp.service_name_prefix = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078269 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.enforce_new_defaults = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078373 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.enforce_scope = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078486 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_default_rule = default {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078624 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078739 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_file = policy.yaml {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078862 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.078964 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079063 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079188 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079296 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079403 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079520 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079647 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.group = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079755 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.helper_command = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079868 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.079975 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080078 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080184 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080288 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080394 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.group = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080491 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.helper_command = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080619 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080736 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080864 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.080970 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081079 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081227 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081336 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081433 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081539 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081677 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081799 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.081918 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.send_service_user_token = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082023 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082128 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082245 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082365 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082584 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082584 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082707 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.082822 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.backend_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chap_password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083668 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chap_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083903 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083903 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.disk_geometry = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.083903 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_client_cert = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084265 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_client_cert_key = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084265 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_data_namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084265 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084265 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084365 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084563 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.enable_unsupported_driver = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084563 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084690 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.filter_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084773 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.goodness_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.084895 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085007 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085109 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085217 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085333 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085483 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iscsi_target_flags = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085634 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iscsi_write_cache = on {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085748 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.085936 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086050 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086156 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086271 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086372 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086475 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_shell_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086602 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086719 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086839 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.086942 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmet_port_id = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087047 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.replication_device = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087152 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.report_discard_supported = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087255 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.reserved_percentage = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087365 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.scst_target_driver = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087469 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.scst_target_iqn_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087595 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.storage_protocol = iSCSI {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087720 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087886 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.087993 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088104 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088211 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_protocol = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088323 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088426 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.trace_flags = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088529 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.unique_fqdn_network = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088662 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.use_chap_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088770 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088891 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_backend_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.088999 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear = zero {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089101 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear_ionice = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089232 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear_size = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089343 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089446 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089550 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089725 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089851 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.file_event_handler = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.089957 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090277 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.log_dir = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090277 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090277 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090388 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090481 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090564 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090723 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090853 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.090961 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091070 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.hostname = np0000004568 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091197 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091339 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091446 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091553 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091710 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091834 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.091939 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092044 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092167 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092277 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092382 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092483 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092604 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092738 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092855 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.092958 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093059 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093184 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093290 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093393 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093494 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093619 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093730 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093851 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.093955 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094063 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094165 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_version = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094269 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094383 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.driver = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094523 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.retry = -1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094710 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094841 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.transport_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.094964 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095187 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095313 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_api_version = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095423 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_endpoint = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095534 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_endpoint_type = public {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095659 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095762 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095877 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.095983 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096085 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096185 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096290 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.number_of_retries = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096396 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.retry_delay = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096496 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.send_service_user_token = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096618 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096753 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096869 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.verify_ssl = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.096974 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.verify_ssl_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097079 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097207 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.auth_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097312 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097417 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097519 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097641 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097746 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097866 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.097971 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098076 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.approle_role_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098176 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.approle_secret_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098288 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_mountpoint = secret {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098388 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098493 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_version = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098611 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098742 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.root_token_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098859 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.ssl_ca_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.098969 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.099070 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.099323 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.099419 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ******************************************************************************** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 04:23:27.099607 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Full set of CONF: {{(pid=101263) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:275}} Jul 05 04:23:27.099723 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ******************************************************************************** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 04:23:27.099812 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] Configuration options gathered from: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 04:23:27.099937 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 04:23:27.100042 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 04:23:27.100118 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ================================================================================ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 04:23:27.100234 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allow_availability_zone_fallback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100330 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allow_compression_on_image_upload = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100417 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] allowed_direct_url_schemes = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100487 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] api_rate_limit = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100564 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] auth_strategy = keystone {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100666 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backdoor_port = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100768 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backdoor_socket = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.100860 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_api_class = cinder.backup.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_compression_algorithm = zlib {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_create_containers = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver_init_check_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101388 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_driver_stats_polling_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101667 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101667 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_max_operations = 15 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101667 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_metadata_version = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101667 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_name_template = backup-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101763 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_native_threads_pool_size = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101763 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_object_number_per_notification = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101947 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_service_inithost_offload = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.101947 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth = per_user {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102018 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102076 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_url = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102149 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_auth_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102229 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_block_size = 32768 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102300 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102376 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_container = volumebackups {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102449 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_create_storage_policy = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102532 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_enable_progress_timer = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102634 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_key = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102741 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_object_size = 52428800 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102835 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_project = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102912 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_project_domain = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.102988 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103065 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_retry_attempts = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103163 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_retry_backoff = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103244 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_service_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103319 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_tenant = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103395 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_url = https://10.4.3.20:8080/v1/AUTH_ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103468 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103548 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_swift_user_domain = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103644 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_timer_interval = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103721 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_use_same_host = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103807 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_use_temp_snapshot = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103884 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backup_workers = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.103959 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chap_password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104035 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chap_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104110 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104185 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_internal_tenant_project_id = 521254754d5040259c9b45bfb6d9314d {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104259 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_internal_tenant_user_id = 6604ccce5c3a4624aeba9a3a5aed3d26 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104332 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] compression_format = gzip {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104408 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_dir = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104484 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104562 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] config_source = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104677 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104786 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] control_exchange = openstack {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104872 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] debug = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.104950 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105026 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_group_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105115 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105213 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] default_volume_type = storpool {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105293 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] disk_geometry = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105368 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_client_cert = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105443 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_client_cert_key = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105520 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_data_namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105624 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_ssl_cert_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105740 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_ssl_cert_verify = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105839 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] driver_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105918 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enable_new_services = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.105994 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enable_unsupported_driver = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106076 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enabled_backends = ['storpool'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106149 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] enforce_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106222 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] filter_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106299 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106374 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_servers = ['https://10.4.3.20/image'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106449 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_api_ssl_compression = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106524 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106638 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_catalog_info = image:glance:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106745 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106842 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106919 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.106995 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_num_retries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107070 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance_request_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107171 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] goodness_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107250 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] graceful_shutdown_timeout = 5 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107325 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] group_api_class = cinder.group.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107402 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] host = np0000004568 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107477 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_compress_on_upload = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107556 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_address_space_limit = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107692 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_cpu_limit = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107826 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.107939 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_conversion_disable = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108055 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_upload_use_cinder_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108171 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_upload_use_internal_tenant = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108269 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108363 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_max_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108460 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] image_volume_cache_max_size_gb = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108577 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] instance_format = [instance: %(uuid)s] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108695 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108807 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iscsi_target_flags = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108886 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iscsi_write_cache = on {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.108962 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109038 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109122 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109214 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109290 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109364 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_color = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109440 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_config_append = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109515 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109620 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_dir = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109702 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109788 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_options = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109873 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotate_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.109949 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotate_interval_type = days {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110022 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] log_rotation_type = none {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110096 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110170 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110247 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110324 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110401 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110477 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_age = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110551 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_logfile_count = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110662 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_logfile_size_mb = 200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110764 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] max_over_subscription_ratio = 20.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110857 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] message_reap_interval = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.110933 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] message_ttl = 2592000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111009 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] monkey_patch = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111086 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] monkey_patch_modules = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111199 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] my_ip = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111281 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] no_snapshot_gb_quota = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111357 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_iser_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111432 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_shell_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111506 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] num_volume_device_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111632 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmeof_conn_info_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111720 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmet_ns_id = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111812 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] nvmet_port_id = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111889 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_max_limit = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.111963 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_ext_list = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112039 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112114 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_listen = 0.0.0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112191 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_listen_port = 8776 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112264 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112338 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] osapi_volume_workers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112413 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] per_volume_size_limit = -1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112490 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] periodic_fuzzy_delay = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112561 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] periodic_interval = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112671 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] project_id_regex = [0-9a-f\-]+ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112769 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] public_endpoint = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112856 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] publish_errors = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.112932 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_backup_gigabytes = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113009 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_backups = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113083 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113184 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_gigabytes = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113263 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_groups = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113337 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_snapshots = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113411 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] quota_volumes = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113487 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_burst = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113561 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_except_level = CRITICAL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113668 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rate_limit_interval = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113746 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] replication_device = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113836 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] report_discard_supported = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113915 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] report_interval = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.113992 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reservation_clean_interval = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114067 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reservation_expire = 86400 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114142 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reserved_image_namespaces = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114218 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] reserved_percentage = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114292 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114365 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114439 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] rpc_response_timeout = 120 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114516 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] run_external_periodic_tasks = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114615 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114723 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scst_target_driver = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114815 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] scst_target_iqn_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114893 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_down_time = 720 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.114969 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] shell_completion = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115045 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] snapshot_name_template = snapshot-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115128 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115224 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] state_path = /opt/stack/data/cinder {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115300 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] storage_availability_zone = nova {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115375 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] storage_protocol = iSCSI {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115449 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115531 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] syslog_log_facility = LOG_USER {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115633 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_helper = lioadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115739 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115866 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.115956 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116033 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_protocol = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116133 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] target_secondary_ip_addresses = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116250 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] trace_flags = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116368 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] transfer_api_class = cinder.transfer.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116492 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] transport_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116637 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] until_refresh = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116769 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_chap_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.116897 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_default_quota_class = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117014 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_journal = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117131 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_json = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117251 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117365 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_stderr = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117483 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] use_syslog = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117617 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] verify_glance_signatures = enabled {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117740 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117870 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_api_class = cinder.volume.api.API {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.117989 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_backend_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118104 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear = zero {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118221 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear_ionice = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118337 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_clear_size = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118452 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118585 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_copy_bps_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118715 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_dd_blocksize = 1M {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118837 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.118952 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_name_template = volume-%s {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.119068 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volume_usage_audit_period = month {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.119182 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 04:23:27.119316 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_concurrency.disable_process_locking = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.119428 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.119549 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.119689 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.119821 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.119936 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120052 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120165 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120283 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120399 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120529 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120669 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120798 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.auth_version = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.120916 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.cache = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121029 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121145 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121260 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.delay_auth_decision = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121374 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121489 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.http_connect_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121624 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121742 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.include_service_catalog = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121864 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.121978 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.interface = public {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122095 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122217 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_password = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122345 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122461 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122578 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122710 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122840 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.122963 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123080 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123202 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123327 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123447 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123547 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123689 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123771 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123868 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.123944 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcache_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124021 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124098 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124175 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124251 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_token_roles_required = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124333 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.service_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124407 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.token_cache_time = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124483 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.20/identity {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124577 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend = dogpile.cache.null {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124686 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend_argument = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124767 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.backend_expiration_time = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124856 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.config_prefix = cache.oslo {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.124932 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.debug_cache_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125022 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enable_retry_client = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125101 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enable_socket_keepalive = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125183 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125260 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.expiration_time = 600 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125339 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125415 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_retry_attempts = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125492 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125577 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_dead_retry = 300 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125681 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125784 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.125904 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_maxsize = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126018 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126123 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_sasl_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126205 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126290 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126371 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.proxies = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126479 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_db = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126618 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_sentinel_service_name = mymaster {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126733 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126830 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.redis_server = localhost:6379 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126910 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.retry_attempts = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.126989 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.retry_delay = 0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127091 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_count = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127202 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_idle = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127305 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_keepalive_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127386 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.socket_timeout = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127462 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_allowed_ciphers = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127538 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127672 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127760 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127855 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.tls_keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.127933 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cache.username = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128018 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] coordination.backend_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128123 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.asyncio_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128202 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.asyncio_slave_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128277 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.backend = sqlalchemy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128352 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128430 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_debug = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128504 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_parameters = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128606 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_recycle_time = 3600 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128718 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.connection_trace = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128816 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_inc_retry_interval = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128896 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_max_retries = 20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.128972 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_max_retry_interval = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129072 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.db_retry_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129162 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_overflow = 50 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129255 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_pool_size = 5 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129332 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.max_retries = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129420 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129517 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.mysql_wsrep_sync_wait = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129626 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.pool_timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129709 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.retry_interval = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129795 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.slave_connection = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129873 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.sqlite_synchronous = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.129950 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.synchronous_reader = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130033 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] database.use_db_reconnect = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130134 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130228 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130308 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130385 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130460 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130540 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.connection_string = messaging:// {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130657 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130761 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_doc_type = notification {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130853 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_scroll_size = 10000 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.130972 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.es_scroll_time = 2m {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131083 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.filter_error_trace = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131197 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.hmac_keys = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131309 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.sentinel_service_name = mymaster {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131421 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.socket_timeout = 0.1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131537 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.trace_requests = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131675 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler.trace_sqlalchemy = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131804 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_jaeger.process_tags = {} {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131900 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_jaeger.service_name_prefix = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.131996 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] profiler_otlp.service_name_prefix = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132101 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.enforce_new_defaults = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132215 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.enforce_scope = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132304 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_default_rule = default {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132382 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132458 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.policy_file = policy.yaml {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132534 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132638 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132759 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132863 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.132941 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133018 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_policy.remote_timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133100 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133179 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.group = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133255 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.helper_command = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133331 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133435 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133552 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133695 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] privsep_osbrick.user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133830 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.133937 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.group = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134033 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.helper_command = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134125 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134218 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134314 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134413 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] cinder_sys_admin.user = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134529 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134658 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134767 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134857 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.134935 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135011 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135087 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135163 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.send_service_user_token = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135238 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135315 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] service_user.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135395 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135469 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.auth_type = password {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135545 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135652 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135731 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135819 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135894 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.135970 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136048 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136120 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] glance.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136209 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.backend_availability_zone = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136287 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chap_password = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136359 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chap_username = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136439 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136511 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.disk_geometry = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136613 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_client_cert = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136717 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_client_cert_key = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136818 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_data_namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136895 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.136976 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137051 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.driver_use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137124 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.enable_unsupported_driver = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137196 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137269 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.filter_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137345 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.goodness_function = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137425 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137496 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137582 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137683 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137762 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137854 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iscsi_target_flags = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.137928 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iscsi_write_cache = on {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138002 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138077 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138158 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138232 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138306 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138379 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138458 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_shell_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138549 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138669 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138784 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138866 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.nvmet_port_id = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.138944 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.replication_device = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139021 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.report_discard_supported = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139095 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.reserved_percentage = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139174 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.scst_target_driver = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139260 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.scst_target_iqn_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139340 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.storage_protocol = iSCSI {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139413 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_helper = tgtadm {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139488 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_ip_address = 10.4.3.20 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139580 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_port = 3260 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139681 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139763 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_protocol = iscsi {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139853 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.139929 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.trace_flags = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140006 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.unique_fqdn_network = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140079 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.use_chap_auth = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140167 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140253 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_backend_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140335 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear = zero {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140407 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear_ionice = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140492 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_clear_size = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140624 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140744 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140864 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.140978 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141098 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.file_event_handler = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141204 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141300 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_reports.log_dir = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141403 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141496 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141616 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141721 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141842 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.141927 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142017 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142090 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142165 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.hostname = np0000004568 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142242 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142318 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142395 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142474 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142548 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142661 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142753 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142848 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.142945 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143061 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143167 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143261 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143340 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143418 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143493 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143584 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143689 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143786 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143868 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.143949 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144065 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144175 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144288 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144405 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144520 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144643 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144742 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.ssl_version = {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144849 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.144957 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.driver = [] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145047 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.retry = -1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145177 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145264 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] oslo_messaging_notifications.transport_url = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145346 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145431 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145510 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_api_version = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145622 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_endpoint = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145715 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_endpoint_type = public {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145808 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.barbican_region_name = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145890 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.145965 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146147 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146216 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146290 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146366 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.number_of_retries = 60 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146443 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.retry_delay = 1 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146520 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.send_service_user_token = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146627 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146712 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146800 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.verify_ssl = True {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146878 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican.verify_ssl_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.146961 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.auth_section = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147040 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.auth_type = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147241 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.cafile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147323 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.certfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147400 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.collect_timing = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147476 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.insecure = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147552 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.keyfile = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147667 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.split_loggers = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147747 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] barbican_service_user.timeout = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147847 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.approle_role_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147922 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.approle_secret_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.147997 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_mountpoint = secret {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148075 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_path = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148150 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.kv_version = 2 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148225 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.namespace = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148302 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.root_token_id = **** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148376 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.ssl_ca_crt_file = None {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148452 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.timeout = 60.0 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148534 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.use_ssl = False {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148649 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 04:23:27.148736 np0000004568 cinder-backup[101263]: DEBUG oslo_service.backend._eventlet.service [None req-1bed192e-de3e-408c-9e79-0369d6e7ad8f None None] ******************************************************************************** {{(pid=101263) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 04:23:27.149026 np0000004568 cinder-backup[101263]: INFO cinder.service [-] Starting cinder-backup node (version 28.1.0) Jul 05 04:23:27.158526 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Acquiring lock "cleanup_incomplete_backups_101263" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 04:23:27.158951 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Lock "cleanup_incomplete_backups_101263" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 04:23:27.159095 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Cleaning up incomplete backup operations. Jul 05 04:23:27.174685 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.lockutils [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Lock "cleanup_incomplete_backups_101263" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.015s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 04:23:27.206511 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:23:27.211705 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:23:27.217808 np0000004568 cinder-backup[101263]: INFO cinder.keymgr.migration [None req-88f49a2a-49bf-465b-a8cb-38987a20bd5c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 04:23:27.223623 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Creating RPC server for service cinder-backup {{(pid=101263) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 04:23:27.227732 np0000004568 cinder-backup[101263]: DEBUG cinder.service [None req-78d1a764-498a-47db-9cdb-3b3311164b89 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=101263) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 04:23:37.226601 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:25:00.249959 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:25:00.250459 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:25:37.261903 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:26:00.256543 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:26:00.256543 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:27:00.256150 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:27:00.256615 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:27:37.251563 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:28:00.261121 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:28:00.261744 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:29:00.265691 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:29:00.266249 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:29:37.272595 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:29:37.278661 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Create backup started, backup: 983c4e82-0be2-4562-92d2-65060f4a07ba volume: 7d5f1cff-1584-49cf-9e4c-7e6e953c1afd. Jul 05 04:29:37.285560 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-915292153',created_at=2026-07-05T04:29:37Z,data_timestamp=2026-07-05T04:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-522431949',encryption_key_id=None,fail_reason=None,host='np0000004568',id=983c4e82-0be2-4562-92d2-65060f4a07ba,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='527eba17ff9444bab69fda7e9af33cf5',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8be1b4de9c3d44108cfd1af8f442d4e8',volume_id=7d5f1cff-1584-49cf-9e4c-7e6e953c1afd) Jul 05 04:29:37.323536 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_527eba17ff9444bab69fda7e9af33cf5 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:29:37.323785 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:29:37.324311 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:29:37.325191 np0000004568 cinder-backup[101263]: INFO oslo.privsep.daemon [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpt89n3coa/privsep.sock'] Jul 05 04:29:37.334588 np0000004568 sudo[120138]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpt89n3coa/privsep.sock Jul 05 04:29:37.335396 np0000004568 sudo[120138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:29:37.597728 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 04:29:37.597882 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 04:29:37.598020 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 04:29:37.598179 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 04:29:37.598328 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 04:29:37.598328 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 04:29:37.598414 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 04:29:37.598476 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 04:29:37.598536 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 04:29:37.939059 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 04:29:37.939306 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 04:29:37.939508 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 04:29:37.939782 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 04:29:37.939833 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 04:29:37.940371 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 04:29:37.940371 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 04:29:37.940371 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 04:29:37.940371 np0000004568 cinder-backup[101263]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 04:29:38.171405 np0000004568 cinder-backup[101263]: INFO oslo.privsep.daemon [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Spawned new privsep daemon via rootwrap Jul 05 04:29:38.171405 np0000004568 cinder-backup[101263]: DEBUG oslo.privsep.daemon [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Accepted privsep connection to /tmp/tmpt89n3coa/privsep.sock {{(pid=101263) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 04:29:38.161743 np0000004568 sudo[120138]: pam_unix(sudo:session): session closed for user root Jul 05 04:29:38.296878 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:29:38.297407 np0000004568 cinder-backup[101263]: WARNING os_brick.initiator.connectors.nvmeof [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 05 04:29:38.321490 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:29:38.335601 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:29:38.335813 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:29:38.346869 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:29:38.350273 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe2b:2f0e', 'fe80::1c:3dff:fed1:2a1', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:fea4:d3ef', 'fe80::9807:abff:fe11:d631', 'fe80::f816:3eff:fe54:ce05', 'fe80::f816:3eff:fe7d:cec7', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7f:4207', 'fe80::100d:57ff:fe15:71a2'] Jul 05 04:29:38.350485 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:29:38.350659 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:29:38.352002 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] <== get_connector_properties: return (1026ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:29:38.874867 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:29:38.875456 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:29:38.875880 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:29:40.334095 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.458s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:29:40.334856 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:29:40.352904 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:29:40.353453 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:29:40.353724 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:29:40.364247 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:29:40.364247 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd] added Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:29:40.374216 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:40.374480 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:29:40.374931 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:29:40.375166 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:29:41.376301 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:29:41.390912 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:29:41.392182 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:41.402947 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.419793 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.420159 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:29:41.467035 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, portal: 192.168.40.100,3260] Jul 05 04:29:41.467035 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, portal: 192.168.40.100,3260] successful. Jul 05 04:29:41.467035 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:41.480591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd (non-flash) Jul 05 04:29:41.499177 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd (non-flash) Jul 05 04:29:41.499507 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:29:41.499765 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:29:41.499765 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:29:41.500948 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] HCTL ('13', '-', '-', 0) found on session 45 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:29:41.501080 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:29:41.519055 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Searching for a device in session 45 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:29:41.519319 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:29:42.523282 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.190s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:29:42.523818 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] <== connect_volume: return (3647ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798973', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:29:42.524356 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:29:42.545659 np0000004568 sudo[120440]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:29:42.546449 np0000004568 sudo[120440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:29:42.920606 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.396s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:29:42.917200 np0000004568 sudo[120440]: pam_unix(sudo:session): session closed for user root Jul 05 04:29:42.968418 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:29:42.974428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-915292153,backup: 983c4e82-0be2-4562-92d2-65060f4a07ba. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:29:43.178461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] generate_object_name_prefix: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:29:43.190389 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] starting backup of volume: 7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, volume size: 1073741824, object names prefix volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:29:43.404141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:43.674919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:43.675404 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:43.799047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:43.799528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:44.059864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:44.328247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:44.328633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:44.450021 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:44.450229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:44.657808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:44.924600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:44.924600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:45.041421 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:45.041646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:45.247617 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:45.509227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:45.509392 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:45.610998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:45.611484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:45.814775 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:46.069702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:46.070236 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:46.175195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:46.175343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:46.384873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:46.651124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:46.651326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:46.790598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:46.790598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:47.042699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:47.312942 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:47.313507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:47.430853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:47.430853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:47.669908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:47.946107 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:47.946219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:48.058808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:48.059002 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:48.307936 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:48.572763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:48.573538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:48.682026 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:48.682229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:48.880401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:49.138337 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:49.138783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:49.257430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:49.257647 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:49.484111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:49.810047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:49.810512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:49.925757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:49.925989 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:50.154976 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:50.392675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:50.392873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:50.491845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:50.492034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:50.713208 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:50.970323 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:50.970684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:51.084353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:51.084523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:51.324472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:51.577683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:51.577683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:51.685506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:51.685831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:51.873908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:52.128165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:52.128626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:52.225709 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:52.225978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:52.434895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:52.679909 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:52.680082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:52.785032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:52.785259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:52.965101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:53.209743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:53.210264 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:53.315994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:53.315994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:53.541257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:53.805374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:53.807820 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:53.925897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:53.926140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:54.129432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:54.384561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:54.384867 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:54.500071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:54.500344 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:54.695627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:54.936104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:54.936257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:55.039275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:55.039510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:55.135097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:29:55.256023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:29:55.256201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:29:55.312894 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup MD5 for volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:29:55.313069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:29:55.319438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:29:55.324502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:29:55.324638 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:29:55.329827 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:29:55.330034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:29:55.334538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:29:55.334799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-915292153, sha256file filename: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:29:55.395760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:29:55.395760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-915292153, metadata filename: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:29:55.416711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "983c4e82-0be2-4562-92d2-65060f4a07ba",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-522431949",\n "created_at": "2026-07-05 04:29:37+00:00",\n "objects": [\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7d5f1cff-1584-49cf-9e4c-7e6e953c1afd",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7d5f1cff-1584-49cf-9e4c-7e6e953c1afd\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8be1b4de9c3d44108cfd1af8f442d4e8\\", \\"project_id\\": \\"527eba17ff9444bab69fda7e9af33cf5\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:29:36.000000\\", \\"launched_at\\": \\"2026-07-05T04:29:36.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-686359202\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:29:36.000000\\", \\"updated_at\\": \\"2026-07-05T04:29:37.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:29:55.421838 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] backup 983c4e82-0be2-4562-92d2-65060f4a07ba finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:29:55.555816 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:29:55.575302 np0000004568 sudo[120923]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:29:55.576150 np0000004568 sudo[120923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:29:55.869785 np0000004568 sudo[120923]: pam_unix(sudo:session): session closed for user root Jul 05 04:29:55.871938 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.316s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:29:55.872577 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798973', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:29:55.872801 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:30:00.264721 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:30:00.265061 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:30:02.656828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.784s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:30:02.657414 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:02.670299 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:02.671163 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:30:02.671163 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:30:02.671163 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:30:02.671609 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a (non-flash) Jul 05 04:30:02.705850 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067 (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a (non-flash) Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-716d123a-3b5c-4f9b-be56-2ee74d170067', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-519a7781-989f-4edd-9b09-ec8dceb733fa', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b588a7f0-b4b0-4540-b22e-dfe07f18f26b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e29b89a8-623a-48be-9022-dd6582628b4a', '49')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:30:02.706842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd', '45')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:30:02.708168 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Resulting device map defaultdict(. at 0x77fe0c1b9d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:30:02.708554 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:30:02.719148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:30:02.727152 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:30:02.776334 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:30:02.776528 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:30:02.778352 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:30:02.790350 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:30:02.790620 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:30:02.801295 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:02.844048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, portal: 192.168.40.100,3260] Jul 05 04:30:02.844048 np0000004568 cinder-backup[101263]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-7d5f1cff-1584-49cf-9e4c-7e6e953c1afd, portal: 192.168.40.100,3260] successful. Jul 05 04:30:02.844048 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:02.863044 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:02.863308 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.207s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:30:02.863488 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] <== disconnect_volume: return (6990ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:30:03.894773 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-fa02847a-2483-4656-bb3f-ac5ffaa676bc tempest-VolumesBackupsV39Test-945006511 None] Create backup finished. backup: 983c4e82-0be2-4562-92d2-65060f4a07ba. Jul 05 04:30:05.047331 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] Delete backup started, backup: 983c4e82-0be2-4562-92d2-65060f4a07ba. Jul 05 04:30:05.052114 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_527eba17ff9444bab69fda7e9af33cf5 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:30:05.052318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:30:05.052531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] delete started, backup: 983c4e82-0be2-4562-92d2-65060f4a07ba, container: tempest-volumesbackupsv39test-backup-container-915292153, prefix: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:30:05.111541 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] generated object list: ['volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00001', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00002', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00003', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00004', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00005', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00006', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00007', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00008', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00009', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00010', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00011', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00012', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00013', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00014', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00015', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00016', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00017', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00018', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00019', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00020', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00021', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_metadata', 'volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:30:05.131893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00001 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.151011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00002 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.173993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00003 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.194678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00004 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.221195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00005 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.239441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00006 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.259588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00007 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.277791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00008 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.301223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00009 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.321123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00010 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.343595 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00011 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.361882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00012 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.381966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00013 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.400424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00014 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.418417 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00015 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.435580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00016 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.452507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00017 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.470352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00018 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.487353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00019 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.505781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00020 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.523981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba-00021 in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.542809 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_metadata in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.562189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] deleted object: volume_7d5f1cff-1584-49cf-9e4c-7e6e953c1afd/20260705042943/az_nova_backup_983c4e82-0be2-4562-92d2-65060f4a07ba_sha256file in container: tempest-volumesbackupsv39test-backup-container-915292153. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:05.562410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] delete 983c4e82-0be2-4562-92d2-65060f4a07ba finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:30:05.593175 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:30:05.614820 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] Created reservations ['84d2e2c0-7238-479f-8203-d4bf264bbd93', 'e28e1af0-19cc-4ad8-98bf-a944db45a41c'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:30:05.736432 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-73401eba-dbdc-459c-859d-a46debb1f6ce tempest-VolumesBackupsV39Test-945006511 None] Delete backup finished, backup 983c4e82-0be2-4562-92d2-65060f4a07ba deleted. Jul 05 04:30:15.733633 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=38,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:30:17.532408 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: 6f71f056-88d0-4b93-87c3-180a2551b44b volume: 02001011-8f4d-4705-9a73-18c096ccad24. Jul 05 04:30:17.536393 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-930581772',created_at=2026-07-05T04:30:17Z,data_timestamp=2026-07-05T04:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-146028517',encryption_key_id=None,fail_reason=None,host='np0000004568',id=6f71f056-88d0-4b93-87c3-180a2551b44b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=02001011-8f4d-4705-9a73-18c096ccad24) Jul 05 04:30:17.595965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:30:17.596162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:30:17.596465 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:30:17.607409 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:30:17.642176 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:30:17.658584 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:30:17.658855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:30:17.667688 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:30:17.669162 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe2b:2f0e', 'fe80::1c:3dff:fed1:2a1', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fea4:d3ef', 'fe80::9807:abff:fe11:d631', 'fe80::f816:3eff:fe54:ce05', 'fe80::f816:3eff:fe7d:cec7', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7f:4207', 'fe80::100d:57ff:fe15:71a2', 'fe80::f816:3eff:feee:799a', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:fe02:7074', 'fe80::8871:3eff:fedd:cd59'] Jul 05 04:30:17.669355 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:30:17.669543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:30:17.669860 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:30:18.177977 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:30:18.178603 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ef60296-4536-40d8-a026-458f32fd5554', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:30:18.178931 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:30:18.180126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:30:18.180126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ef60296-4536-40d8-a026-458f32fd5554', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:30:18.193559 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:30:18.194230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:30:18.194455 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:30:18.211194 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:30:18.211194 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554] added Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0279(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:30:18.223162 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:30:19.224109 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:30:19.234859 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:19.244356 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.257162 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.257398 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:30:19.298190 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554, portal: 192.168.40.100,3260] Jul 05 04:30:19.298190 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554, portal: 192.168.40.100,3260] successful. Jul 05 04:30:19.298190 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:19.310165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 (non-flash) Jul 05 04:30:19.333614 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 (non-flash) Jul 05 04:30:19.333996 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:30:19.334267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:30:19.334717 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:30:19.335601 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] HCTL ('9', '-', '-', 0) found on session 52 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:30:19.336037 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:30:19.352506 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 52 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:30:19.352723 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ef60296-4536-40d8-a026-458f32fd5554', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:30:20.357492 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.177s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:30:20.357981 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2178ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798979', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:30:20.358403 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:30:20.378190 np0000004568 sudo[121879]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:30:20.378996 np0000004568 sudo[121879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:30:20.696717 np0000004568 sudo[121879]: pam_unix(sudo:session): session closed for user root Jul 05 04:30:20.698594 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.340s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:30:20.738837 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:30:20.746438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: tempest-volumesbackupstest-backup-container-930581772,backup: 6f71f056-88d0-4b93-87c3-180a2551b44b. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:30:20.874128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:30:20.879225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: 02001011-8f4d-4705-9a73-18c096ccad24, volume size: 1073741824, object names prefix volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:30:21.089990 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:21.365063 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:21.365398 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:21.481185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:21.481358 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:21.697762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:21.949065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:21.949265 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:22.049424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:22.049613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:22.225664 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:22.474030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:22.474422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:22.572798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:22.573009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:22.785778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:23.038819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:23.039052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:23.144685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:23.144863 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:23.346039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:23.594843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:23.595284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:23.692691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:23.692843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:23.903064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:24.151321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:24.151451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:24.277173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:24.277418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:24.520664 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:24.773037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:24.773415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:24.887457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:24.887641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:25.077811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:25.317682 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:25.317987 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:25.420739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:25.420946 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:25.619045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:25.888743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:25.889111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:25.989093 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:25.989285 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:26.175335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:26.415117 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:26.415240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:26.514980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:26.515140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:26.710748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:26.972123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:26.972481 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:27.073587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:27.073762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:27.288700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:27.536857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:27.537940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:27.646461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:27.646461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:27.908311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:28.176852 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:28.177184 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:28.290921 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:28.291150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:28.516634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:28.761415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:28.761548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:28.969735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:28.969911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:29.181497 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:29.452485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:29.452723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:29.564851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:29.564851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:29.785262 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:30.044327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:30.044496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:30.165095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:30.165335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:30.398101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:30.654249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:30.654343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:30.785534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:30.785748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:31.000427 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:31.281131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:31.281268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:31.391267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:31.391506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:31.584866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:31.833815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:31.834114 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:31.945463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:31.945663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:32.199066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:32.456407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:32.456594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:32.562518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:32.562712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:32.662321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:30:32.794185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:30:32.794402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:30:32.861981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:30:32.862138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:30:32.869458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:30:32.877244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:30:32.877400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:30:32.881949 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:30:32.882153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:30:32.885809 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:30:32.886178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-930581772, sha256file filename: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:30:32.963878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:30:32.964542 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-930581772, metadata filename: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:30:32.989178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6f71f056-88d0-4b93-87c3-180a2551b44b",\n "backup_name": "tempest-VolumesBackupsTest-Backup-146028517",\n "created_at": "2026-07-05 04:30:17+00:00",\n "objects": [\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "02001011-8f4d-4705-9a73-18c096ccad24",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"02001011-8f4d-4705-9a73-18c096ccad24\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:29:08.000000\\", \\"launched_at\\": \\"2026-07-05T04:29:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-857949223\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:29:08.000000\\", \\"updated_at\\": \\"2026-07-05T04:30:17.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:30:32.998364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] backup 6f71f056-88d0-4b93-87c3-180a2551b44b finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:30:33.123996 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:30:33.149996 np0000004568 sudo[122120]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:30:33.151285 np0000004568 sudo[122120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:30:33.491480 np0000004568 sudo[122120]: pam_unix(sudo:session): session closed for user root Jul 05 04:30:33.494371 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.370s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:30:33.495230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ef60296-4536-40d8-a026-458f32fd5554', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798979', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:30:33.495507 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:30:33.496128 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:30:33.496540 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ef60296-4536-40d8-a026-458f32fd5554', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:30:33.508498 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:33.509112 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:30:33.509112 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:30:33.509112 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:30:33.509112 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554 (non-flash) Jul 05 04:30:33.537855 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:30:33.538184 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02001011-8f4d-4705-9a73-18c096ccad24', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', '52')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:30:33.538184 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554', '52')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:30:33.539130 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fe0bfe1d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:30:33.539355 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:30:33.551171 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:30:33.560284 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:30:33.619315 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:30:33.619562 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:30:33.620670 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:30:33.631616 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:30:33.631885 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:30:33.643186 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:33.678756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554, portal: 192.168.40.100,3260] Jul 05 04:30:33.678756 np0000004568 cinder-backup[101263]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-2ef60296-4536-40d8-a026-458f32fd5554, portal: 192.168.40.100,3260] successful. Jul 05 04:30:33.678756 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:33.695074 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:30:33.695433 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:30:33.695696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (199ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:30:34.733772 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3135ed45-5667-4ccb-8b7e-d74117b878cd tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: 6f71f056-88d0-4b93-87c3-180a2551b44b. Jul 05 04:30:35.080317 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: 6f71f056-88d0-4b93-87c3-180a2551b44b. Jul 05 04:30:35.084774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:30:35.085012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:30:35.085335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] delete started, backup: 6f71f056-88d0-4b93-87c3-180a2551b44b, container: tempest-volumesbackupstest-backup-container-930581772, prefix: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:30:35.145819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00001', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00002', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00003', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00004', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00005', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00006', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00007', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00008', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00009', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00010', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00011', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00012', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00013', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00014', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00015', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00016', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00017', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00018', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00019', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00020', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00021', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_metadata', 'volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:30:35.166765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00001 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.192695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00002 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.221684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00003 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.252752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00004 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.280116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00005 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.299557 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00006 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.319274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00007 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.341795 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00008 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.366353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00009 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.393388 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00010 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.414544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00011 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.434932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00012 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.462946 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00013 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.484081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00014 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.515941 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00015 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.544670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00016 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.569186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00017 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.586429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00018 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.616153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00019 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.642885 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00020 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.676955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b-00021 in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.706698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_metadata in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.728679 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_02001011-8f4d-4705-9a73-18c096ccad24/20260705043020/az_nova_backup_6f71f056-88d0-4b93-87c3-180a2551b44b_sha256file in container: tempest-volumesbackupstest-backup-container-930581772. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:30:35.728949 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] delete 6f71f056-88d0-4b93-87c3-180a2551b44b finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:30:35.789520 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:30:35.808581 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] Created reservations ['0033018f-cb9c-48e3-90b2-5c7ea7d01226', '0eb016ac-3829-4da2-9c91-3c33178880f8'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:30:35.837436 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3229a0ad-e223-4563-8c8c-5ef65a7c14b9 tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup 6f71f056-88d0-4b93-87c3-180a2551b44b deleted. Jul 05 04:30:45.834513 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:30:52.785095 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: 73e20678-b579-4a81-ab4a-4130c36bd163 volume: a22d0f3d-4f8f-478d-a009-569d7834f198. Jul 05 04:30:52.799557 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-198858426',created_at=2026-07-05T04:30:52Z,data_timestamp=2026-07-05T04:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-175446395',encryption_key_id=None,fail_reason=None,host='np0000004568',id=73e20678-b579-4a81-ab4a-4130c36bd163,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=a22d0f3d-4f8f-478d-a009-569d7834f198) Jul 05 04:30:52.833037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:30:52.833325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:30:52.833797 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:30:52.847857 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:30:52.868465 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:30:52.882367 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:30:52.882727 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:30:52.892088 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:30:52.893532 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:fe02:7074', 'fe80::8871:3eff:fedd:cd59', 'fe80::f816:3eff:fe05:381d', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:fe0e:9b2c', 'fe80::100d:57ff:fe15:71a2', 'fe80::f816:3eff:fe37:416', 'fe80::b04a:a3ff:fe36:3536', 'fe80::2831:abff:fefd:6d00'] Jul 05 04:30:52.894159 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:30:52.894394 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:30:52.894800 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:30:53.401702 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:30:53.402075 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22d0f3d-4f8f-478d-a009-569d7834f198', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:30:53.402271 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:00.267644 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:31:00.268094 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:31:02.087337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 8.685s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:02.087704 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22d0f3d-4f8f-478d-a009-569d7834f198', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:31:02.097762 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:02.098318 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:02.098634 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:02.109093 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:31:02.109093 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198] added Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:02.118760 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:02.119233 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:31:02.119684 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:31:02.119933 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:31:02.825360 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:31:03.120728 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:31:03.133897 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:03.148300 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.162619 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.162870 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:03.201261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198, portal: 192.168.40.100,3260] Jul 05 04:31:03.201261 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198, portal: 192.168.40.100,3260] successful. Jul 05 04:31:03.201261 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:03.211371 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 (non-flash) Jul 05 04:31:03.226367 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-33f6e3f9-acda-40cd-9e97-5cde63ee3c74 (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 (non-flash) Jul 05 04:31:03.226687 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:03.226878 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:03.227011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:31:03.227962 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] HCTL ('13', '-', '-', 0) found on session 59 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:31:03.228136 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:31:03.240644 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 59 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:31:03.240948 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22d0f3d-4f8f-478d-a009-569d7834f198', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:31:04.246622 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:04.246622 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (10842ms) {'type': 'block', 'scsi_wwn': '33000000004ebbf5e', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:04.246622 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:04.263656 np0000004568 sudo[123473]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:31:04.264330 np0000004568 sudo[123473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:04.608804 np0000004568 sudo[123473]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:04.613345 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.365s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:04.674078 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:31:04.682327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: tempest-volumesbackupstest-backup-container-198858426,backup: 73e20678-b579-4a81-ab4a-4130c36bd163. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:31:04.744446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:31:04.750861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: a22d0f3d-4f8f-478d-a009-569d7834f198, volume size: 1073741824, object names prefix volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:31:04.983097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:05.670457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:05.670964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:05.924001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:05.924165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:06.121368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:06.379479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:06.379623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:06.484143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:06.484343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:06.694754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:06.981092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:06.981274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:07.107420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003: a35891500449df17e893f84bd88472fb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:07.107560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:07.335932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:07.596549 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:07.596711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:07.704381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:07.704829 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:07.923698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:08.207096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:08.207413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:08.335769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:08.336044 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:08.579948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:08.860952 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:08.861369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:08.971471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:08.971659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:09.167896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:09.421026 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:09.421540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:09.534280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:09.534280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:09.800177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:10.057364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:10.057744 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:10.187283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:10.187283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:10.413164 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:10.672377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:10.672511 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:10.803803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:10.803908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:11.037164 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:11.317151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:11.317151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:11.431991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:11.431991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:11.668054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:11.924830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:11.925022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:12.040758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:12.040938 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:12.270201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:12.519507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:12.519895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:12.640020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:12.640221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:12.874488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:13.125591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:13.125591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:13.233538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:13.233538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:13.489629 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:13.759153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:13.759552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:13.874630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:13.874818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:14.099997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:14.355918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:14.355918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:14.461775 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:14.461924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:14.690170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:14.940080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:14.940446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:15.052171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:15.052326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:15.265730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:15.525059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:15.525504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:15.634315 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:15.634315 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:15.827969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:16.081155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:16.081531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:16.206411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:16.206411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:16.436195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:16.692330 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:16.692607 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:16.796075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:16.796328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:16.986098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:17.248430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:17.248964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:17.367482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:17.367683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:17.474866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:17.597258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:17.597438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:17.658096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:17.658239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:17.664224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:31:17.668711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:31:17.668888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:31:17.672277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:31:17.672448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:31:17.675587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 04:31:17.675869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-198858426, sha256file filename: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:31:17.742543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:31:17.743139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-198858426, metadata filename: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:31:17.766174 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "73e20678-b579-4a81-ab4a-4130c36bd163",\n "backup_name": "tempest-VolumesBackupsTest-Backup-175446395",\n "created_at": "2026-07-05 04:30:53+00:00",\n "objects": [\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a22d0f3d-4f8f-478d-a009-569d7834f198",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a22d0f3d-4f8f-478d-a009-569d7834f198\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:30:52.000000\\", \\"launched_at\\": \\"2026-07-05T04:30:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-333609469\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:30:51.000000\\", \\"updated_at\\": \\"2026-07-05T04:30:53.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"e01f3214-b74f-47dd-a99b-2ae9aad3efec\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:31:17.771226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] backup 73e20678-b579-4a81-ab4a-4130c36bd163 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:31:17.897815 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:17.915030 np0000004568 sudo[123872]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:31:17.915682 np0000004568 sudo[123872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:18.217392 np0000004568 sudo[123872]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:18.220469 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.322s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:18.221509 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22d0f3d-4f8f-478d-a009-569d7834f198', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000004ebbf5e', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:18.221509 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:19.978717 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.757s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:19.980165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22d0f3d-4f8f-478d-a009-569d7834f198', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:19.993677 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:19.994287 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:31:19.994287 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:31:19.994287 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:31:19.994287 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:20.020419 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198 (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:20.020719 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:20.020966 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '61')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:31:20.021065 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198', '59')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:31:20.022319 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fe0c2ce3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:31:20.022731 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:31:20.034473 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:31:20.044246 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:31:20.088548 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:31:20.088799 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:31:20.090291 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:31:20.101200 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:31:20.101583 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:31:20.112085 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:20.176722 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198, portal: 192.168.40.100,3260] Jul 05 04:31:20.176722 np0000004568 cinder-backup[101263]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-a22d0f3d-4f8f-478d-a009-569d7834f198, portal: 192.168.40.100,3260] successful. Jul 05 04:31:20.176722 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:20.191107 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:20.191379 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.213s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:20.191564 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (1969ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:21.220393 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ab895ed8-bb9a-4ce8-91d4-e2a5fd20054d tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: 73e20678-b579-4a81-ab4a-4130c36bd163. Jul 05 04:31:22.823707 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Restore backup started, backup: 73e20678-b579-4a81-ab4a-4130c36bd163 volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. Jul 05 04:31:22.847495 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:31:22.848003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:31:22.848370 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:22.858756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:31:22.882241 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:22.894321 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:31:22.894660 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:31:22.902341 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:31:22.903902 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:fe0e:9b2c', 'fe80::100d:57ff:fe15:71a2', 'fe80::f816:3eff:febc:e7a2', 'fe80::2831:abff:fefd:6d00', 'fe80::f816:3eff:fe54:ce05', 'fe80::f816:3eff:fe9c:8384', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe05:381d', 'fe80::34df:c7ff:fe13:9e95'] Jul 05 04:31:22.905298 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:31:22.905298 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:31:22.905298 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:23.913144 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:31:23.913822 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:23.914191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:23.914763 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:23.915048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:31:23.925882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:23.926391 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:23.926792 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:23.936745 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:31:23.936745 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d] added Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:23.948352 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:23.948722 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:31:23.949129 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:31:23.949340 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:31:24.949937 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:31:24.961912 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:24.972837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:24.989340 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:24.989953 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:25.029342 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d, portal: 192.168.40.100,3260] Jul 05 04:31:25.029342 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d, portal: 192.168.40.100,3260] successful. Jul 05 04:31:25.029342 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:25.042352 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d (non-flash) Jul 05 04:31:25.059830 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d (non-flash) Jul 05 04:31:25.060135 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:25.060345 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:25.060486 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:31:25.061319 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] HCTL ('11', '-', '-', 0) found on session 62 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:31:25.061457 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:31:25.074120 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 62 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:31:25.074120 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:31:26.077200 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.162s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:26.077742 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798999', 'path': '/dev/sdf'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:26.077900 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:26.101743 np0000004568 sudo[124159]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 05 04:31:26.102791 np0000004568 sudo[124159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:26.498419 np0000004568 sudo[124159]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:26.501136 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.423s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:26.501639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] starting restore of backup volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163 container: tempest-volumesbackupstest-backup-container-198858426, to new volume 673fa181-e13c-4ae9-a942-5c40c9ebf65d, backup: 73e20678-b579-4a81-ab4a-4130c36bd163. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:31:26.501844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-198858426, metadata filename: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] _read_metadata finished. Metadata: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "backup_id": "73e20678-b579-4a81-ab4a-4130c36bd163", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-175446395", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:30:53+00:00", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021": { Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: ], Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_id": "a22d0f3d-4f8f-478d-a009-569d7834f198", Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a22d0f3d-4f8f-478d-a009-569d7834f198\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3332890ff7524ae593ed58751133681b\", \"project_id\": \"6ae5e615014a4de2b73e1686d477f623\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:30:52.000000\", \"launched_at\": \"2026-07-05T04:30:52.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-333609469\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:30:51.000000\", \"updated_at\": \"2026-07-05T04:30:53.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"e01f3214-b74f-47dd-a99b-2ae9aad3efec\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 04:31:26.533786 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:31:26.537520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:31:26.537520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-198858426, metadata filename: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] _read_metadata finished. Metadata: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "backup_id": "73e20678-b579-4a81-ab4a-4130c36bd163", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-175446395", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:30:53+00:00", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021": { Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: } Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: ], Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_id": "a22d0f3d-4f8f-478d-a009-569d7834f198", Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a22d0f3d-4f8f-478d-a009-569d7834f198\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3332890ff7524ae593ed58751133681b\", \"project_id\": \"6ae5e615014a4de2b73e1686d477f623\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:30:52.000000\", \"launched_at\": \"2026-07-05T04:30:52.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-333609469\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:30:51.000000\", \"updated_at\": \"2026-07-05T04:30:53.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"e01f3214-b74f-47dd-a99b-2ae9aad3efec\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 04:31:26.550051 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:31:26.553758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] v1 volume backup restore of 73e20678-b579-4a81-ab4a-4130c36bd163 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:31:26.553758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] metadata_object_names = ['volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:31:26.589738 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:31:26.622321 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:31:26.626155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:26.731589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:27.184084 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:27.201339 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:27.564537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:27.588235 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:27.966912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:27.990147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:28.346042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:28.360783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:28.700247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:28.716826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:29.059341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:29.076878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:29.473328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:29.491001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:29.862948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:29.878173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:30.225333 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:30.244166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:30.657897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:30.675430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:31.072711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:31.096922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:31.436363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:31.452001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:31.779433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:31.803785 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:32.159526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:32.178067 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:32.528965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:32.548533 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:32.884210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:32.904320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:33.274447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:33.290510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:33.624052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:33.639036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:33.968171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:33.984451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:34.363899 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, object name: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021, volume: 673fa181-e13c-4ae9-a942-5c40c9ebf65d. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:31:34.379938 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:31:34.554690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] v1 volume backup restore of 73e20678-b579-4a81-ab4a-4130c36bd163 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:31:34.555064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:31:34.568477 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:31:34.568759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Restoring volume glance metadata {{(pid=101263) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 05 04:31:34.691512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] restore 73e20678-b579-4a81-ab4a-4130c36bd163 to 673fa181-e13c-4ae9-a942-5c40c9ebf65d finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:31:34.700551 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:34.723516 np0000004568 sudo[124259]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 05 04:31:34.724167 np0000004568 sudo[124259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:35.077945 np0000004568 sudo[124259]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:35.080390 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.380s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:35.081142 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798999', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:35.081418 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:35.082097 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:35.082752 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '673fa181-e13c-4ae9-a942-5c40c9ebf65d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:31:35.096205 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:35.097077 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:31:35.097077 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:31:35.097077 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:31:35.097077 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d (non-flash) Jul 05 04:31:35.124327 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d (non-flash) Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:35.124757 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-14b0f0c9-b420-4754-9965-740ad0ab3ceb', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', '62')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:31:35.125049 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d', '62')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:31:35.126203 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fe0c912160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d'): ({'sdf'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:31:35.126479 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdf {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:31:35.141768 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdf {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:31:35.151334 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:31:35.214105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:31:35.214306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:31:35.215396 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:31:35.226447 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:31:35.226812 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:31:35.238038 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:35.282584 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d, portal: 192.168.40.100,3260] Jul 05 04:31:35.282584 np0000004568 cinder-backup[101263]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-673fa181-e13c-4ae9-a942-5c40c9ebf65d, portal: 192.168.40.100,3260] successful. Jul 05 04:31:35.282584 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:35.300293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:35.300599 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.219s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:35.301343 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (219ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:36.324968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Encryption key ID for volume 673fa181-e13c-4ae9-a942-5c40c9ebf65d already matches encryption key ID in backup 73e20678-b579-4a81-ab4a-4130c36bd163. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:31:36.349098 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-6f63f401-fab7-49b4-a956-fa752331b4e8 tempest-VolumesBackupsTest-1912920348 None] Finished restoring backup 73e20678-b579-4a81-ab4a-4130c36bd163 to volume 673fa181-e13c-4ae9-a942-5c40c9ebf65d. Jul 05 04:31:38.433732 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: 73e20678-b579-4a81-ab4a-4130c36bd163. Jul 05 04:31:38.438014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:31:38.438214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:31:38.438427 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] delete started, backup: 73e20678-b579-4a81-ab4a-4130c36bd163, container: tempest-volumesbackupstest-backup-container-198858426, prefix: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:31:38.482709 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata', 'volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:31:38.510520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00001 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.530530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00002 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.551029 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00003 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.569367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00004 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.591195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00005 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.614641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00006 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.634480 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00007 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.655341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00008 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.675639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00009 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.698434 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00010 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.718741 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00011 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.742432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00012 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.764734 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00013 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.801717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00014 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.827535 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00015 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.853224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00016 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.880090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00017 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.904310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00018 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.929686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00019 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.955510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00020 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:38.980935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163-00021 in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:39.002832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_metadata in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:39.022249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a22d0f3d-4f8f-478d-a009-569d7834f198/20260705043104/az_nova_backup_73e20678-b579-4a81-ab4a-4130c36bd163_sha256file in container: tempest-volumesbackupstest-backup-container-198858426. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:31:39.023025 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] delete 73e20678-b579-4a81-ab4a-4130c36bd163 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:31:39.068511 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:31:39.083463 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] Created reservations ['ad28890b-6b7c-4c46-9fe7-ffa1385c00e3', '962a18e6-934a-444c-ae7e-9fda66eb32c3'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:31:39.113231 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4fc4d1a2-ae7e-4f59-be1b-b4e8dd9f50a5 tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup 73e20678-b579-4a81-ab4a-4130c36bd163 deleted. Jul 05 04:31:41.978289 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: 311ba15b-f67d-4bcf-8150-39508cac32d1 volume: 4f8f0595-4e3e-4522-8852-79c255cd7e80. Jul 05 04:31:41.983588 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-2006774065',created_at=2026-07-05T04:31:41Z,data_timestamp=2026-07-05T04:31:41Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-1030854324',display_name='tempest-VolumesBackupsTest-Backup-634415839',encryption_key_id=None,fail_reason=None,host='np0000004568',id=311ba15b-f67d-4bcf-8150-39508cac32d1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=4f8f0595-4e3e-4522-8852-79c255cd7e80) Jul 05 04:31:42.009375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:31:42.009653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:31:42.009932 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:42.023735 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:31:42.045454 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:42.057164 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:31:42.057450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:31:42.067701 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:31:42.068994 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:febc:e7a2', 'fe80::2831:abff:fefd:6d00', 'fe80::f816:3eff:fe54:ce05', 'fe80::f816:3eff:fe9c:8384', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe05:381d', 'fe80::34df:c7ff:fe13:9e95'] Jul 05 04:31:42.069129 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:31:42.069249 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:31:42.069489 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:42.574257 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:31:42.574708 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8f0595-4e3e-4522-8852-79c255cd7e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:42.574878 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:42.575316 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:42.575554 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8f0595-4e3e-4522-8852-79c255cd7e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:31:42.588358 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:31:42.589694 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:31:42.589694 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:42.601952 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:31:42.601952 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80] added Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:31:42.614344 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:42.614688 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:31:42.615201 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:31:42.615310 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:31:43.616874 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:31:43.628496 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:43.639764 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.653679 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.653889 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:43.702034 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80, portal: 192.168.40.100,3260] Jul 05 04:31:43.702034 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80, portal: 192.168.40.100,3260] successful. Jul 05 04:31:43.702034 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:43.717653 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 (non-flash) Jul 05 04:31:43.735265 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 (non-flash) Jul 05 04:31:43.735706 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:31:43.735939 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:43.736354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:31:43.738451 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] HCTL ('7', '-', '-', 0) found on session 65 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:31:43.738671 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:31:43.759127 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 65 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:31:43.759127 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8f0595-4e3e-4522-8852-79c255cd7e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:31:44.759960 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:31:44.760346 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2185ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799008', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:31:44.760480 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:44.779037 np0000004568 sudo[124583]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:31:44.779664 np0000004568 sudo[124583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:45.120267 np0000004568 sudo[124583]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:45.122269 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.361s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:45.179164 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:31:45.190594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: tempest-volumesbackupstest-backup-container-2006774065,backup: 311ba15b-f67d-4bcf-8150-39508cac32d1. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:31:45.247952 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:31:45.253410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: 4f8f0595-4e3e-4522-8852-79c255cd7e80, volume size: 1073741824, object names prefix volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:31:45.440887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:45.702552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:45.702749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:45.814138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:45.814525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:45.997994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:46.243109 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:46.243347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:46.348682 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:46.348897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:46.596730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:46.858194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:46.858762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:46.984385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:46.984683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:47.190081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:47.466248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:47.466469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:47.575354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:47.575673 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:47.777395 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:48.025832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:48.026364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:48.144406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:48.144821 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:48.386295 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:48.646038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:48.646241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:48.743601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:48.743832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:48.928793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:49.169880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:49.170287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:49.273634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:49.273861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:49.460885 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:49.702653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:49.702791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:49.811211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:49.811457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:50.006526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:50.249474 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:50.249474 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:50.367564 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:50.367787 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:50.609442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:50.870393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:50.870544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:50.974842 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:50.975141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:51.161504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:51.423839 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:51.424246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:51.525955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:51.526196 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:51.738996 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:51.986039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:51.986290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:52.086749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:52.086938 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:52.313811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:52.557765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:52.558130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:52.671957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:52.672190 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:52.858208 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:53.102977 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:53.103204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:53.208670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:53.208912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:53.447093 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:53.706299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:53.706730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:53.822050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:53.822247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:54.045005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:54.299186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:54.299186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:54.415079 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:54.415245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:54.597216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:54.847375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:54.847375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:54.971802 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:54.972122 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:55.195232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:55.442929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:55.443128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:55.559733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:55.560109 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:55.804126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:56.052857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:56.053287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:56.170695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:56.170856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:56.389781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:56.640360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:56.640543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:56.756685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:56.756830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:56.887028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:31:57.009499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:31:57.009675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:31:57.084089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:31:57.084089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:31:57.093867 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:31:57.100923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:31:57.100923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:31:57.106284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jul 05 04:31:57.106516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:31:57.110139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:31:57.110386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-2006774065, sha256file filename: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:31:57.191267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:31:57.191412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-2006774065, metadata filename: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:31:57.219060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-1030854324",\n "backup_id": "311ba15b-f67d-4bcf-8150-39508cac32d1",\n "backup_name": "tempest-VolumesBackupsTest-Backup-634415839",\n "created_at": "2026-07-05 04:31:42+00:00",\n "objects": [\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4f8f0595-4e3e-4522-8852-79c255cd7e80",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4f8f0595-4e3e-4522-8852-79c255cd7e80\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:31:41.000000\\", \\"launched_at\\": \\"2026-07-05T04:31:41.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2006685163\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:31:41.000000\\", \\"updated_at\\": \\"2026-07-05T04:31:42.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:31:57.226653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] backup 311ba15b-f67d-4bcf-8150-39508cac32d1 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:31:57.358171 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:31:57.376215 np0000004568 sudo[125343]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:31:57.376842 np0000004568 sudo[125343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:31:57.683292 np0000004568 sudo[125343]: pam_unix(sudo:session): session closed for user root Jul 05 04:31:57.685774 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.327s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:31:57.686630 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8f0595-4e3e-4522-8852-79c255cd7e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799008', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:31:57.686968 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:32:00.251314 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.564s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:32:00.252406 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f8f0595-4e3e-4522-8852-79c255cd7e80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:32:00.267148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:32:00.272219 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:32:00.272686 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee', '71')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80', '65')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fe0cff3ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:32:00.302349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:32:00.314330 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:32:00.324328 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:32:00.372921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:32:00.372921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:32:00.372921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:32:00.385635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:32:00.386377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:32:00.397208 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:00.446624 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80, portal: 192.168.40.100,3260] Jul 05 04:32:00.446624 np0000004568 cinder-backup[101263]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4f8f0595-4e3e-4522-8852-79c255cd7e80, portal: 192.168.40.100,3260] successful. Jul 05 04:32:00.446624 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:00.469588 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:00.469588 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.218s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:32:00.469588 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (2782ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:32:01.494538 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-47e122c0-b44d-4cb0-8eee-db2e22e44e85 tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1. Jul 05 04:32:03.756993 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Restore backup started, backup: 311ba15b-f67d-4bcf-8150-39508cac32d1 volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. Jul 05 04:32:03.759927 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=125,cinder:UPDATE=21,cinder:INSERT=17 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:32:03.773244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:32:03.773489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:32:03.775687 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:32:03.789699 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:32:03.810717 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:32:03.822326 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:32:03.822645 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:32:03.830435 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:32:03.831828 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe84:3031', 'fe80::dc02:d2ff:fe03:486', 'fe80::f816:3eff:fe38:8bc7', 'fe80::f816:3eff:fe0a:3642', 'fe80::f816:3eff:fe98:3e70', 'fe80::f816:3eff:fe54:ce05', 'fe80::f816:3eff:fe9c:8384', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe05:381d', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:fe0e:9b2c', 'fe80::100d:57ff:fe15:71a2', 'fe80::f816:3eff:fe78:ebb4', 'fe80::9864:dff:feea:f768', 'fe80::f816:3eff:fe2c:2ddb'] Jul 05 04:32:03.832017 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:32:03.832095 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:32:03.832318 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:32:04.844124 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:32:04.847631 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:32:04.847631 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:32:04.847631 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:32:04.847631 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:32:04.856521 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:32:04.856960 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:32:04.857173 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:32:04.873587 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:32:04.873587 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63] added Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:32:04.883138 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:04.883347 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:32:04.883763 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:32:04.884035 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:32:05.885692 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:32:05.898440 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:05.910200 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:05.931148 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:32:05.976790 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, portal: 192.168.40.100,3260] Jul 05 04:32:05.976790 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, portal: 192.168.40.100,3260] successful. Jul 05 04:32:05.976790 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:05.989618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 (non-flash) Jul 05 04:32:06.010798 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11c52159-dfec-4f49-a21d-47fb69f6a95c (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2734230-1026-411e-85e6-53375fbbf636 (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b53b11f-28f3-4e9e-9425-9e7f39c196ee (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 (non-flash) Jul 05 04:32:06.011247 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:32:06.011635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:32:06.011635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:32:06.012769 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] HCTL ('7', '-', '-', 0) found on session 72 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:32:06.013196 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:32:06.032044 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 72 and hctl ['7', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:32:07.033788 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 72 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:32:07.034232 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:32:07.034937 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.189s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:32:07.035091 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2190ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799020', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:32:07.035466 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:32:07.056416 np0000004568 sudo[125676]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:32:07.057062 np0000004568 sudo[125676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:32:07.384825 np0000004568 sudo[125676]: pam_unix(sudo:session): session closed for user root Jul 05 04:32:07.387401 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.351s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:32:07.387946 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] starting restore of backup volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1 container: tempest-volumesbackupstest-backup-container-2006774065, to new volume 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, backup: 311ba15b-f67d-4bcf-8150-39508cac32d1. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:32:07.388127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-2006774065, metadata filename: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] _read_metadata finished. Metadata: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "backup_description": "tempest-backup-description-1030854324", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "backup_id": "311ba15b-f67d-4bcf-8150-39508cac32d1", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-634415839", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:31:42+00:00", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021": { Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: ], Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_id": "4f8f0595-4e3e-4522-8852-79c255cd7e80", Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4f8f0595-4e3e-4522-8852-79c255cd7e80\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3332890ff7524ae593ed58751133681b\", \"project_id\": \"6ae5e615014a4de2b73e1686d477f623\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:31:41.000000\", \"launched_at\": \"2026-07-05T04:31:41.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2006685163\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:31:41.000000\", \"updated_at\": \"2026-07-05T04:31:42.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 05 04:32:07.405186 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:32:07.410267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:32:07.410267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-2006774065, metadata filename: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] _read_metadata finished. Metadata: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "backup_description": "tempest-backup-description-1030854324", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "backup_id": "311ba15b-f67d-4bcf-8150-39508cac32d1", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-634415839", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:31:42+00:00", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021": { Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: } Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: ], Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_id": "4f8f0595-4e3e-4522-8852-79c255cd7e80", Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4f8f0595-4e3e-4522-8852-79c255cd7e80\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3332890ff7524ae593ed58751133681b\", \"project_id\": \"6ae5e615014a4de2b73e1686d477f623\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:31:41.000000\", \"launched_at\": \"2026-07-05T04:31:41.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2006685163\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:31:41.000000\", \"updated_at\": \"2026-07-05T04:31:42.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 05 04:32:07.420951 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:32:07.424889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] v1 volume backup restore of 311ba15b-f67d-4bcf-8150-39508cac32d1 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:32:07.424889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] metadata_object_names = ['volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:32:07.462382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:32:07.512506 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:32:07.517068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:07.532653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:07.925621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:07.945453 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:08.332954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:08.351157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:08.758031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:08.776307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:09.115269 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:09.131243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:09.469514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:09.482159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:09.864079 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:09.876836 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:10.225647 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:10.248516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:10.597298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:10.612435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:10.967076 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:10.981179 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:11.316820 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:11.330184 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:11.686610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:11.702816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:12.033584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:12.047491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:12.372712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:12.388448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:12.769230 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:12.784686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:13.117350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:13.130767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:13.465104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:13.485322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:13.864168 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:13.891503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:14.241434 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:14.257188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:14.592931 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:14.619920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:14.961951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restoring object. backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, object name: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021, volume: 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:32:14.980186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:32:15.176663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] v1 volume backup restore of 311ba15b-f67d-4bcf-8150-39508cac32d1 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:32:15.176903 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:32:15.187338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Restoring volume metadata {{(pid=101263) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jul 05 04:32:15.195331 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:32:15.195509 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] restore 311ba15b-f67d-4bcf-8150-39508cac32d1 to 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:32:15.195943 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:32:15.216263 np0000004568 sudo[126071]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:32:15.217314 np0000004568 sudo[126071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:32:15.553883 np0000004568 sudo[126071]: pam_unix(sudo:session): session closed for user root Jul 05 04:32:15.556382 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.360s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:32:15.557378 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799020', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:32:15.557378 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:32:15.557805 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:32:15.558222 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:32:15.569579 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:15.570342 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:32:15.570342 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:32:15.570342 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:32:15.570342 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52 (non-flash) Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e95b46b2-5879-4888-ab8b-69559a036c4e', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c397ede-4dec-4485-9868-0006d0e8ed52', '74')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:32:15.596296 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63', '72')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:32:15.597131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fe0c85fd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:32:15.597359 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:32:15.608165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:32:15.617063 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:32:15.670327 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:32:15.670495 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:32:15.672281 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:32:15.686279 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:32:15.686502 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:32:15.698740 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:15.737970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, portal: 192.168.40.100,3260] Jul 05 04:32:15.737970 np0000004568 cinder-backup[101263]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-9992dffd-ddfb-4d7a-a656-d6a8a74bbc63, portal: 192.168.40.100,3260] successful. Jul 05 04:32:15.737970 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:15.753468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:32:15.753622 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.196s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:32:15.753835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (196ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:32:16.770740 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Encryption key ID for volume 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63 already matches encryption key ID in backup 311ba15b-f67d-4bcf-8150-39508cac32d1. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:32:16.787489 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-02f8c93a-56dd-4298-a14e-4b34e922ca25 tempest-VolumesBackupsTest-1912920348 None] Finished restoring backup 311ba15b-f67d-4bcf-8150-39508cac32d1 to volume 9992dffd-ddfb-4d7a-a656-d6a8a74bbc63. Jul 05 04:32:18.314611 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: 311ba15b-f67d-4bcf-8150-39508cac32d1. Jul 05 04:32:18.318694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:32:18.318906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:32:18.319083 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] delete started, backup: 311ba15b-f67d-4bcf-8150-39508cac32d1, container: tempest-volumesbackupstest-backup-container-2006774065, prefix: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:32:18.352521 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata', 'volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:32:18.371814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00001 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.390803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00002 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.408517 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00003 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.427360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00004 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.444830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00005 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.461860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00006 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.478925 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00007 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.496905 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00008 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.514343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00009 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.532202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00010 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.550052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00011 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.568298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00012 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.588137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00013 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.616123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00014 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.637643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00015 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.660701 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00016 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.682191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00017 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.705082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00018 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.724260 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00019 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.744399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00020 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.764309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1-00021 in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.785798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_metadata in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.804753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_4f8f0595-4e3e-4522-8852-79c255cd7e80/20260705043145/az_nova_backup_311ba15b-f67d-4bcf-8150-39508cac32d1_sha256file in container: tempest-volumesbackupstest-backup-container-2006774065. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:32:18.804999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] delete 311ba15b-f67d-4bcf-8150-39508cac32d1 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:32:18.847726 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:32:18.861627 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] Created reservations ['24d751d5-967c-45b9-9792-12f24f69cf55', 'f142441e-2ab8-4c0e-bd09-758676c4b9fd'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:32:18.885668 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8aa85a44-3f3d-406c-804f-2b9f389b7f14 tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup 311ba15b-f67d-4bcf-8150-39508cac32d1 deleted. Jul 05 04:32:28.881934 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=36,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:33:00.276700 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:33:00.277168 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:33:25.319956 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Create backup started, backup: e4ac43fb-8b68-40b5-9899-91f562c73006 volume: adc0fa30-aa0c-47dd-8888-cc13656b5047. Jul 05 04:33:25.325125 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-2134208080',created_at=2026-07-05T04:33:25Z,data_timestamp=2026-07-05T04:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-271492812',encryption_key_id=None,fail_reason=None,host='np0000004568',id=e4ac43fb-8b68-40b5-9899-91f562c73006,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8ffd1169d4414447b21c7c86d36a1523',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='984260d7331c4a52a01e58a8117e48fe',volume_id=adc0fa30-aa0c-47dd-8888-cc13656b5047) Jul 05 04:33:25.348465 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8ffd1169d4414447b21c7c86d36a1523 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:25.348674 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:25.349009 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:25.359522 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:33:25.376330 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:25.389022 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:33:25.389271 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:33:25.396304 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:33:25.397712 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe3c:1c2e', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7e:fa96', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe78:ebb4', 'fe80::9864:dff:feea:f768', 'fe80::f816:3eff:fe7c:b759', 'fe80::e4c9:d1ff:fe2b:4bef', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481'] Jul 05 04:33:25.397850 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:33:25.397989 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:33:25.398266 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:25.901928 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:33:25.902326 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adc0fa30-aa0c-47dd-8888-cc13656b5047', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:25.902502 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:27.293675 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-dcbd7ef9-084c-4f85-9ec1-06689f4072ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:33:27.989094 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.086s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:27.989363 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adc0fa30-aa0c-47dd-8888-cc13656b5047', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:33:28.006609 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:28.007094 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:28.007411 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:28.017417 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:33:28.017417 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047] added Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:28.028698 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:28.028926 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:33:28.029508 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:33:28.029720 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:33:28.492661 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: ff270e4d-aec0-459e-b4c3-44d38067e31f volume: a1a31896-6a42-484c-b5bf-d59763910b0d. Jul 05 04:33:28.499608 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-370029117',created_at=2026-07-05T04:33:28Z,data_timestamp=2026-07-05T04:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2094455369',encryption_key_id=None,fail_reason=None,host='np0000004568',id=ff270e4d-aec0-459e-b4c3-44d38067e31f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=a1a31896-6a42-484c-b5bf-d59763910b0d) Jul 05 04:33:28.579902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:28.580226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:28.580671 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:28.592011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:33:28.612693 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:28.624316 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:33:28.624659 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:33:28.633724 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:33:28.635090 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe3c:1c2e', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7e:fa96', 'fe80::1038:b6ff:fed2:469e', 'fe80::f816:3eff:fe78:ebb4', 'fe80::9864:dff:feea:f768', 'fe80::f816:3eff:fe7c:b759', 'fe80::e4c9:d1ff:fe2b:4bef', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481'] Jul 05 04:33:28.635240 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:33:28.635371 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:33:28.635893 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:29.031214 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:33:29.042847 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:29.055723 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.078619 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.079046 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:29.122519 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047, portal: 192.168.40.100,3260] Jul 05 04:33:29.122519 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047, portal: 192.168.40.100,3260] successful. Jul 05 04:33:29.122519 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:29.134350 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:29.141014 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:33:29.141441 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:29.141790 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:29.152033 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:29.152505 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:29.153016 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:29.153196 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:33:29.154261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] HCTL ('15', '-', '-', 0) found on session 89 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:33:29.154508 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:33:29.170971 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Searching for a device in session 89 and hctl ['15', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:30.175683 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Searching for a device in session 89 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:30.175683 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adc0fa30-aa0c-47dd-8888-cc13656b5047', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:33:30.175683 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:30.175683 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] <== connect_volume: return (4270ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799037', 'path': '/dev/sdj'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:30.175683 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:30.179670 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.037s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:30.180016 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:33:30.192267 np0000004568 sudo[129643]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 05 04:33:30.192915 np0000004568 sudo[129643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:30.193921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:30.193921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:30.193921 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:30.222110 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:33:30.222110 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4] added Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:33:30.241250 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0477(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:33:30.241582 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:33:30.520078 np0000004568 sudo[129643]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:30.523181 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.350s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:30.603485 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:33:30.610727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-2134208080,backup: e4ac43fb-8b68-40b5-9899-91f562c73006. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:33:30.813511 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] generate_object_name_prefix: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:33:30.818532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] starting backup of volume: adc0fa30-aa0c-47dd-8888-cc13656b5047, volume size: 1073741824, object names prefix volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:33:31.015919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:31.243003 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:33:31.260975 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:31.266699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:31.266699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:31.275837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:31.297222 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:31.297604 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:31.356601 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4, portal: 192.168.40.100,3260] Jul 05 04:33:31.356601 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4, portal: 192.168.40.100,3260] successful. Jul 05 04:33:31.356601 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:31.376622 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:31.387275 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ee62d11-d731-4d34-9df1-b84ddc0cbb93 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6e3450-9bc7-4e58-9a7c-2c191c0d8c11 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:31.387740 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:31.388017 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:31.388091 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:33:31.389690 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] HCTL ('16', '-', '-', 0) found on session 90 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:33:31.389887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:33:31.396615 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:31.397010 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:31.407161 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 90 and hctl ['16', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:31.608652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:31.878613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:31.878613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:31.988267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:31.988497 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:32.235333 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:32.408705 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 90 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:32.409155 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:33:32.410619 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.231s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:32.410619 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (3268ms) {'type': 'block', 'scsi_wwn': '330000000efdd296f', 'path': '/dev/sdk'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:32.410619 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:32.435156 np0000004568 sudo[129859]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jul 05 04:33:32.436093 np0000004568 sudo[129859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:32.493967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:32.493967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:32.610806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:32.611039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:32.791033 np0000004568 sudo[129859]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:32.793458 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.382s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:32.804159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: tempest-volumesbackupstest-backup-container-370029117,backup: ff270e4d-aec0-459e-b4c3-44d38067e31f. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:33:32.872307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:32.887410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:33:32.894036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: a1a31896-6a42-484c-b5bf-d59763910b0d, volume size: 1073741824, object names prefix volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:33:33.108088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:33.171723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:33.172123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:33.290182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:33.290419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:33.406774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:33.407015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:33.500080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:33.532475 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:33.532747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:33.744992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:33.773024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:33.773024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:33.898221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:33.898447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:34.021396 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:34.021532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:34.100503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:34.123032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:34.123258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:34.337091 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:34.360038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:34.360208 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:34.479375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:34.479699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:34.632111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:34.632549 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:34.679200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:34.747711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:34.747973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:34.950150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:34.950277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:34.965205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:35.052301 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:35.052479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:35.238277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:35.238450 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:35.277130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:35.339526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:35.339774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:35.545903 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:35.571604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:35.571604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:35.682817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:35.683311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:35.819818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:35.820094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:35.905813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:35.929582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:35.929784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:36.111777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:36.147387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:36.147387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:36.260878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:36.261101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:36.383282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:36.383394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:36.448129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:36.488597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:36.488742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:36.667928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:36.705278 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:36.705730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:36.809935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:36.810079 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:36.946963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:36.947166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:37.001184 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:37.049730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:37.049876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:37.242404 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:37.257836 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:37.258022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:37.359778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:37.359963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:37.487036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:37.487279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:37.547181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:37.589052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:37.589263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:37.776056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:37.807262 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:37.807447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:37.913546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:37.913546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:38.030929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:38.031051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:38.096745 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:38.134109 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:38.134318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:38.315530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:38.366191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:38.366332 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:38.467564 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:38.467793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:38.578988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:38.579247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:38.649797 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:38.694024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:38.694256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:38.880174 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:38.910263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:38.910422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:39.013156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:39.013367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:39.126765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:39.127026 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:39.209781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:39.239424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:39.239623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:39.433578 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:39.475400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:39.475656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:39.574520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:39.574742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:39.680955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:39.681146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:39.782022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:39.802096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:39.802311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:39.992367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:40.033737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:40.033985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:40.137972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:40.138196 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:40.250157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:40.250369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:40.317916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:40.364411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:40.364795 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:40.544955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:40.566869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:40.567028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:40.675744 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:40.675913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:40.802182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:40.802317 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:40.875200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:40.907182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:40.907413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:41.134836 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:41.172112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:41.172286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:41.285900 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:41.286187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:41.395271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:41.395425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:41.497341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:41.497341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:41.523490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:41.730057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:41.787912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:41.788837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:41.912027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:41.912205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:42.001909 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:42.002085 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:42.108381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:42.109463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:42.116209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:42.359472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:42.403094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:42.403327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:42.514350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:42.514583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:42.613681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:42.617537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:42.617783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:42.726581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:42.726767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:42.739104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:42.739104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:42.820645 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:42.820822 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:42.829492 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:33:42.836354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:33:42.836645 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:33:42.841707 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:33:42.841707 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:33:42.847112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:33:42.847505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-2134208080, sha256file filename: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:33:42.931692 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:33:42.932439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-2134208080, metadata filename: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:33:42.941004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:42.972174 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "e4ac43fb-8b68-40b5-9899-91f562c73006",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-271492812",\n "created_at": "2026-07-05 04:33:25+00:00",\n "objects": [\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "adc0fa30-aa0c-47dd-8888-cc13656b5047",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"adc0fa30-aa0c-47dd-8888-cc13656b5047\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"984260d7331c4a52a01e58a8117e48fe\\", \\"project_id\\": \\"8ffd1169d4414447b21c7c86d36a1523\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:33:24.000000\\", \\"launched_at\\": \\"2026-07-05T04:33:24.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1507038921\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:33:24.000000\\", \\"updated_at\\": \\"2026-07-05T04:33:25.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:33:42.987592 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] backup e4ac43fb-8b68-40b5-9899-91f562c73006 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:33:43.127965 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:43.148872 np0000004568 sudo[130341]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 05 04:33:43.149542 np0000004568 sudo[130341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:43.202054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:43.202329 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:43.317820 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:43.318057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:43.524928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:43.528157 np0000004568 sudo[130341]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:43.530041 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.402s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:43.530634 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adc0fa30-aa0c-47dd-8888-cc13656b5047', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799037', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:43.530850 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:43.531279 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:43.531650 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adc0fa30-aa0c-47dd-8888-cc13656b5047', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:43.542877 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:43.543430 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:33:43.543430 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:33:43.543430 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:33:43.543430 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:43.567163 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047 (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:43.567449 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:43.567755 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', '90')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:33:43.567755 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047', '89')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:33:43.568686 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Resulting device map defaultdict(. at 0x77fe0c6393a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047'): ({'sdj'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:33:43.568898 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Removing single pathed devices sdj {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:33:43.578369 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Flushing IO for device /dev/sdj {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:33:43.586711 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:33:43.627134 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:33:43.627350 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] SCSI volumes sdj have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:33:43.628555 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:33:43.638838 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:33:43.639113 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:33:43.649537 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:43.681313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047, portal: 192.168.40.100,3260] Jul 05 04:33:43.681313 np0000004568 cinder-backup[101263]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-adc0fa30-aa0c-47dd-8888-cc13656b5047, portal: 192.168.40.100,3260] successful. Jul 05 04:33:43.681313 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:43.696546 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:43.696835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.166s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:43.696997 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] <== disconnect_volume: return (166ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:43.769939 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:43.770144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:43.879591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:43.879794 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:44.057037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:44.333940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:44.334181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:44.448151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:44.448394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:44.557246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:33:44.685912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:33:44.686072 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:33:44.724914 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e25d5f63-38a3-4a47-931a-8dc42ee02c0f tempest-VolumesBackupsAdminTest-129643724 None] Create backup finished. backup: e4ac43fb-8b68-40b5-9899-91f562c73006. Jul 05 04:33:44.753008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup MD5 for volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:33:44.753163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:33:44.758829 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:33:44.764077 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:33:44.764216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:33:44.767339 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:33:44.767462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:33:44.769893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:33:44.770092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-370029117, sha256file filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:33:44.821394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:33:44.821961 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-370029117, metadata filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:33:44.845504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ff270e4d-aec0-459e-b4c3-44d38067e31f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-2094455369",\n "created_at": "2026-07-05 04:33:28+00:00",\n "objects": [\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a1a31896-6a42-484c-b5bf-d59763910b0d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a1a31896-6a42-484c-b5bf-d59763910b0d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:32:21.000000\\", \\"launched_at\\": \\"2026-07-05T04:32:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-105740927\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:32:21.000000\\", \\"updated_at\\": \\"2026-07-05T04:33:28.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:33:44.855599 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] backup ff270e4d-aec0-459e-b4c3-44d38067e31f finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:33:44.976091 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:44.985836 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-2c25e1e7-6c2e-4253-a40f-7dcf2b5ad234 tempest-VolumesBackupsAdminTest-1192588857 None] Export record started, backup: e4ac43fb-8b68-40b5-9899-91f562c73006. Jul 05 04:33:44.990820 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-2c25e1e7-6c2e-4253-a40f-7dcf2b5ad234 tempest-VolumesBackupsAdminTest-1192588857 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_ef150076a514418db3dd83cda85744d9 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:44.991022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-2c25e1e7-6c2e-4253-a40f-7dcf2b5ad234 tempest-VolumesBackupsAdminTest-1192588857 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:44.991448 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-2c25e1e7-6c2e-4253-a40f-7dcf2b5ad234 tempest-VolumesBackupsAdminTest-1192588857 None] Export record finished, backup e4ac43fb-8b68-40b5-9899-91f562c73006 exported. Jul 05 04:33:44.997698 np0000004568 sudo[130389]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jul 05 04:33:44.998506 np0000004568 sudo[130389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:45.307380 np0000004568 sudo[130389]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:45.309136 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.333s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:45.309716 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000efdd296f', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:45.309964 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:45.944793 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-850491be-8470-4e6c-a961-cc18bf7b7337 tempest-VolumesBackupsAdminTest-1192588857 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiYjg2ZGZkYjctYjBmOC00YTc5LWE1OTctYzllYjY2YjIwYzJlIiwgInVzZXJfaWQiOiAiOTg0MjYwZDczMzFjNGE1MmEwMWU1OGE4MTE3ZTQ4ZmUiLCAicHJvamVjdF9pZCI6ICI4ZmZkMTE2OWQ0NDE0NDQ3YjIxYzdjODZkMzZhMTUyMyIsICJ2b2x1bWVfaWQiOiAiYWRjMGZhMzAtYWEwYy00N2RkLTg4ODgtY2MxMzY1NmI1MDQ3IiwgImhvc3QiOiAibnAwMDAwMDA0NTY4IiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInRlbXBlc3Qtdm9sdW1lc2JhY2t1cHNhZG1pbnRlc3QtYmFja3VwLWNvbnRhaW5lci0yMTM0MjA4MDgwIiwgInBhcmVudF9pZCI6IG51bGwsICJzdGF0dXMiOiAiYXZhaWxhYmxlIiwgImZhaWxfcmVhc29uIjogbnVsbCwgInNpemUiOiAxLCAiZGlzcGxheV9uYW1lIjogInRlbXBlc3QtVm9sdW1lc0JhY2t1cHNBZG1pblRlc3QtQmFja3VwLTI3MTQ5MjgxMiIsICJkaXNwbGF5X2Rlc2NyaXB0aW9uIjogbnVsbCwgInNlcnZpY2VfbWV0YWRhdGEiOiAidm9sdW1lX2FkYzBmYTMwLWFhMGMtNDdkZC04ODg4LWNjMTM2NTZiNTA0Ny8yMDI2MDcwNTA0MzMzMC9hel9ub3ZhX2JhY2t1cF9lNGFjNDNmYi04YjY4LTQwYjUtOTg5OS05MWY1NjJjNzMwMDYiLCAic2VydmljZSI6ICJjaW5kZXIuYmFja3VwLmRyaXZlcnMuc3dpZnQuU3dpZnRCYWNrdXBEcml2ZXIiLCAib2JqZWN0X2NvdW50IjogMjEsICJ0ZW1wX3ZvbHVtZV9pZCI6IG51bGwsICJ0ZW1wX3NuYXBzaG90X2lkIjogbnVsbCwgIm51bV9kZXBlbmRlbnRfYmFja3VwcyI6IDAsICJzbmFwc2hvdF9pZCI6IG51bGwsICJkYXRhX3RpbWVzdGFtcCI6ICIyMDI2LTA3LTA1VDA0OjMzOjI1WiIsICJyZXN0b3JlX3ZvbHVtZV9pZCI6IG51bGwsICJtZXRhZGF0YSI6IHt9LCAiZW5jcnlwdGlvbl9rZXlfaWQiOiBudWxsLCAiY3JlYXRlZF9hdCI6ICIyMDI2LTA3LTA1VDA0OjMzOjI1WiIsICJ1cGRhdGVkX2F0IjogIjIwMjYtMDctMDVUMDQ6MzM6NDVaIiwgImRlbGV0ZWRfYXQiOiBudWxsLCAiZGVsZXRlZCI6IGZhbHNlfQ==. Jul 05 04:33:45.944793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-850491be-8470-4e6c-a961-cc18bf7b7337 tempest-VolumesBackupsAdminTest-1192588857 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_ef150076a514418db3dd83cda85744d9 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:45.944793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-850491be-8470-4e6c-a961-cc18bf7b7337 tempest-VolumesBackupsAdminTest-1192588857 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:45.944793 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-850491be-8470-4e6c-a961-cc18bf7b7337 tempest-VolumesBackupsAdminTest-1192588857 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:33:45.944793 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-850491be-8470-4e6c-a961-cc18bf7b7337 tempest-VolumesBackupsAdminTest-1192588857 None] Import record id b86dfdb7-b0f8-4a79-a597-c9eb66b20c2e metadata from driver finished. Jul 05 04:33:47.771509 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Restore backup started, backup: e4ac43fb-8b68-40b5-9899-91f562c73006 volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. Jul 05 04:33:47.780790 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8ffd1169d4414447b21c7c86d36a1523 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:47.781102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:47.781461 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:47.793891 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:33:47.796074 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.486s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:47.796420 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:47.810577 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:47.811132 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:33:47.811132 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:33:47.811132 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:33:47.811132 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:33:47.816308 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:47.828151 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:33:47.828397 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:33:47.836562 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:33:47.837843 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe3c:1c2e', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7c:b759', 'fe80::e4c9:d1ff:fe2b:4bef', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481'] Jul 05 04:33:47.837984 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:33:47.838137 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:33:47.838357 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:47.841155 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4 (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:47.841341 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:47.841489 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15', '92')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:33:47.841667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4', '90')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:33:47.842543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fdedd34400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4'): ({'sdk'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:33:47.842832 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdk {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:33:47.854248 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdk {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:33:47.861838 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:33:47.906916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:33:47.907102 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdk have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:33:47.908198 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:33:47.918780 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:33:47.919052 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:33:47.929967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:47.961817 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4, portal: 192.168.40.100,3260] Jul 05 04:33:47.961817 np0000004568 cinder-backup[101263]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fbc53ff9-7d30-4c93-904d-ebed15a49cb4, portal: 192.168.40.100,3260] successful. Jul 05 04:33:47.961817 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:47.976299 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:47.976748 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:47.976921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (2667ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:48.847043 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:33:48.847618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21fc1696-5d73-4d90-9d43-787bb27a8b77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:48.847748 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:48.848276 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:48.848562 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21fc1696-5d73-4d90-9d43-787bb27a8b77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:33:48.860047 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:48.860560 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:48.861276 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:48.871357 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:33:48.871357 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77] added Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:48.882857 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:48.883101 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:33:48.883613 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:33:48.883882 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:33:49.024519 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:33:49.060817 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f78afbb5-481d-406c-9666-ab4a67193657 tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: ff270e4d-aec0-459e-b4c3-44d38067e31f. Jul 05 04:33:49.884743 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:33:49.895214 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:49.905688 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.919760 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.919974 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:49.960822 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77, portal: 192.168.40.100,3260] Jul 05 04:33:49.960822 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77, portal: 192.168.40.100,3260] successful. Jul 05 04:33:49.960822 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:49.970956 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:49.985665 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:49.986614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:49.986614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:33:49.987415 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] HCTL ('13', '-', '-', 0) found on session 93 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:33:49.987628 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:33:50.001954 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Searching for a device in session 93 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:50.002176 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21fc1696-5d73-4d90-9d43-787bb27a8b77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:33:50.102330 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: 29bcd485-6f55-42a0-ae5c-2a8764914442 volume: a1a31896-6a42-484c-b5bf-d59763910b0d. Jul 05 04:33:50.106779 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:33:50Z,data_timestamp=2026-07-05T04:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004568',id=29bcd485-6f55-42a0-ae5c-2a8764914442,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(ff270e4d-aec0-459e-b4c3-44d38067e31f),parent_id='ff270e4d-aec0-459e-b4c3-44d38067e31f',project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=a1a31896-6a42-484c-b5bf-d59763910b0d) Jul 05 04:33:50.170192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:33:50.170444 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:33:50.170776 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:50.179976 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:33:50.195998 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:50.208343 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:33:50.208628 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:33:50.220172 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:33:50.221647 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe3c:1c2e', 'fe80::34df:c7ff:fe13:9e95', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe7c:b759', 'fe80::e4c9:d1ff:fe2b:4bef', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481'] Jul 05 04:33:50.221647 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:33:50.221647 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:33:50.222276 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:50.725948 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:33:50.726367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5559f73d-53ed-41bc-b07a-de19592f51d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:50.726538 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:51.005672 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:51.006054 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] <== connect_volume: return (2158ms) {'type': 'block', 'scsi_wwn': '330000000036d4595', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:51.006416 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:51.017091 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.286s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:51.020909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5559f73d-53ed-41bc-b07a-de19592f51d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:33:51.023360 np0000004568 sudo[130696]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:33:51.023977 np0000004568 sudo[130696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:51.033393 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:51.033883 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:51.034124 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:51.046181 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:33:51.046181 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9] added Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:33:51.057966 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:51.058181 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:33:51.058517 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:33:51.058720 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:33:51.369025 np0000004568 sudo[130696]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:51.370941 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.364s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:51.371306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] starting restore of backup volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006 container: tempest-volumesbackupsadmintest-backup-container-2134208080, to new volume 21fc1696-5d73-4d90-9d43-787bb27a8b77, backup: e4ac43fb-8b68-40b5-9899-91f562c73006. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:33:51.371484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-2134208080, metadata filename: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] _read_metadata finished. Metadata: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "backup_id": "e4ac43fb-8b68-40b5-9899-91f562c73006", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-271492812", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:33:25+00:00", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021": { Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: ], Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_id": "adc0fa30-aa0c-47dd-8888-cc13656b5047", Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"adc0fa30-aa0c-47dd-8888-cc13656b5047\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"984260d7331c4a52a01e58a8117e48fe\", \"project_id\": \"8ffd1169d4414447b21c7c86d36a1523\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:33:24.000000\", \"launched_at\": \"2026-07-05T04:33:24.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1507038921\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:33:24.000000\", \"updated_at\": \"2026-07-05T04:33:25.000000\"}}" Jul 05 04:33:51.398651 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:33:51.405138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:33:51.405138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-2134208080, metadata filename: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] _read_metadata finished. Metadata: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "backup_id": "e4ac43fb-8b68-40b5-9899-91f562c73006", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-271492812", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:33:25+00:00", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021": { Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: } Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: ], Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_id": "adc0fa30-aa0c-47dd-8888-cc13656b5047", Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"adc0fa30-aa0c-47dd-8888-cc13656b5047\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"984260d7331c4a52a01e58a8117e48fe\", \"project_id\": \"8ffd1169d4414447b21c7c86d36a1523\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:33:24.000000\", \"launched_at\": \"2026-07-05T04:33:24.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1507038921\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:33:24.000000\", \"updated_at\": \"2026-07-05T04:33:25.000000\"}}" Jul 05 04:33:51.416489 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:33:51.419191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] v1 volume backup restore of e4ac43fb-8b68-40b5-9899-91f562c73006 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:33:51.419191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] metadata_object_names = ['volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:33:51.457479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] generated object list: ['volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:33:51.508422 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:33:51.513064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:51.531374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:51.914742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:51.933357 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:52.059731 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:33:52.072435 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:52.083979 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:52.100016 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:52.100207 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:52.138941 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9, portal: 192.168.40.100,3260] Jul 05 04:33:52.138941 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9, portal: 192.168.40.100,3260] successful. Jul 05 04:33:52.138941 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:52.293597 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:52.300723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:33:52.309561 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae9a09ec-4f8d-4088-9a69-c352f9b9777d (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c03881c1-b251-4c68-bc70-1d0ebb4e6d15 (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:33:52.309775 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:52.310057 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.276s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:52.310231 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:33:52.311422 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] HCTL ('14', '-', '-', 0) found on session 94 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:33:52.311552 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:33:52.321769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:52.329390 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 94 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:33:52.329390 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5559f73d-53ed-41bc-b07a-de19592f51d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:33:52.690036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:52.703445 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:53.034969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:53.050089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:53.379558 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.367s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:33:53.379916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2653ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799045', 'path': '/dev/sdi'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:33:53.380182 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:53.397087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:53.400231 np0000004568 sudo[130750]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 05 04:33:53.400956 np0000004568 sudo[130750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:53.416375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:53.778747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:53.791705 np0000004568 sudo[130750]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:53.794900 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.413s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:53.807589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:53.808782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-370029117, sha256 filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:33:53.857954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:33:53.864472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: volumebackups,backup: 29bcd485-6f55-42a0-ae5c-2a8764914442. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:33:53.921268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:33:53.933888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: a1a31896-6a42-484c-b5bf-d59763910b0d, volume size: 1073741824, object names prefix volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:33:54.216202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:54.233188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:54.617550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:54.638873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:55.017185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:55.054289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:55.417085 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:55.446041 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:55.820589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:55.837838 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:56.189117 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:56.211424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:56.582305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:56.601419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:56.944934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:56.973316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:57.331632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:57.350182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:57.716216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:57.737120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:58.098530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:58.119271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:58.477592 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:58.492413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:58.848882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:58.864667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:59.213588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restoring object. backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, object name: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021, volume: 21fc1696-5d73-4d90-9d43-787bb27a8b77. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:33:59.228813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:33:59.396737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] v1 volume backup restore of e4ac43fb-8b68-40b5-9899-91f562c73006 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:33:59.397154 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:33:59.415795 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:33:59.415984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:33:59.416165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] restore e4ac43fb-8b68-40b5-9899-91f562c73006 to 21fc1696-5d73-4d90-9d43-787bb27a8b77 finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:33:59.416696 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:33:59.439275 np0000004568 sudo[130990]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:33:59.440020 np0000004568 sudo[130990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:33:59.776546 np0000004568 sudo[130990]: pam_unix(sudo:session): session closed for user root Jul 05 04:33:59.784088 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.367s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:33:59.784694 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21fc1696-5d73-4d90-9d43-787bb27a8b77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000036d4595', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:33:59.784912 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:33:59.785439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:33:59.785888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21fc1696-5d73-4d90-9d43-787bb27a8b77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:33:59.800080 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:59.800554 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:33:59.800554 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:33:59.800554 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:33:59.800744 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:33:59.823165 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77 (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:33:59.823368 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:33:59.823556 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '96')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:33:59.823753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77', '93')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:33:59.825152 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Resulting device map defaultdict(. at 0x77fdedd15620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:33:59.825439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:33:59.836968 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:33:59.845537 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:33:59.910214 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:33:59.910383 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:33:59.911479 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:33:59.922313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:33:59.922554 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:33:59.933027 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:33:59.980984 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77, portal: 192.168.40.100,3260] Jul 05 04:33:59.980984 np0000004568 cinder-backup[101263]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-21fc1696-5d73-4d90-9d43-787bb27a8b77, portal: 192.168.40.100,3260] successful. Jul 05 04:33:59.980984 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:00.000958 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:00.001314 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.216s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:00.001522 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] <== disconnect_volume: return (216ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:00.275788 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:34:00.276165 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:34:00.592241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:34:00.606422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:34:00.606579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:34:00.611974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:34:00.612134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:34:00.614652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:34:00.614916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:34:00.692209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:34:00.692698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:34:00.734126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "29bcd485-6f55-42a0-ae5c-2a8764914442",\n "backup_name": null,\n "created_at": "2026-07-05 04:33:50+00:00",\n "objects": [],\n "parent_id": "ff270e4d-aec0-459e-b4c3-44d38067e31f",\n "version": "1.0.0",\n "volume_id": "a1a31896-6a42-484c-b5bf-d59763910b0d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a1a31896-6a42-484c-b5bf-d59763910b0d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:32:21.000000\\", \\"launched_at\\": \\"2026-07-05T04:32:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-105740927\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:32:21.000000\\", \\"updated_at\\": \\"2026-07-05T04:33:50.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:34:00.746275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] backup 29bcd485-6f55-42a0-ae5c-2a8764914442 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:34:00.891847 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:00.910395 np0000004568 sudo[131059]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 05 04:34:00.911039 np0000004568 sudo[131059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:34:01.017075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Encryption key ID for volume 21fc1696-5d73-4d90-9d43-787bb27a8b77 already matches encryption key ID in backup e4ac43fb-8b68-40b5-9899-91f562c73006. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:34:01.043037 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e57a9cfc-74ac-41d2-972a-118bdee5b533 tempest-VolumesBackupsAdminTest-129643724 None] Finished restoring backup e4ac43fb-8b68-40b5-9899-91f562c73006 to volume 21fc1696-5d73-4d90-9d43-787bb27a8b77. Jul 05 04:34:01.280560 np0000004568 sudo[131059]: pam_unix(sudo:session): session closed for user root Jul 05 04:34:01.282465 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.391s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:34:01.283052 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5559f73d-53ed-41bc-b07a-de19592f51d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799045', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:01.283252 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:01.283787 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:01.284215 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5559f73d-53ed-41bc-b07a-de19592f51d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:01.295317 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:01.295825 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:34:01.295825 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:34:01.295825 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:34:01.295887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:34:01.306273 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Delete backup started, backup: b86dfdb7-b0f8-4a79-a597-c9eb66b20c2e. Jul 05 04:34:01.313413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_ef150076a514418db3dd83cda85744d9 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:01.313707 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:01.314246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] delete started, backup: b86dfdb7-b0f8-4a79-a597-c9eb66b20c2e, container: tempest-volumesbackupsadmintest-backup-container-2134208080, prefix: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:01.334191 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9 (non-flash) Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:01.334453 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:01.334669 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '96')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:34:01.334902 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9', '94')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:34:01.336094 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fdedd35e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9'): ({'sdi'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:34:01.336400 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdi {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:34:01.350596 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdi {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:34:01.357899 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:34:01.411101 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:34:01.411280 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:34:01.412157 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:34:01.425253 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:34:01.425712 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:34:01.440826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:01.483067 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9, portal: 192.168.40.100,3260] Jul 05 04:34:01.483067 np0000004568 cinder-backup[101263]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-5559f73d-53ed-41bc-b07a-de19592f51d9, portal: 192.168.40.100,3260] successful. Jul 05 04:34:01.483067 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:01.495887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:01.496144 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.212s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:01.496439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (212ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:01.515304 np0000004568 cinder-backup[101263]: WARNING cinder.backup.chunkeddriver [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Error while listing objects, continuing with delete.: swiftclient.exceptions.ClientException: Container GET failed: https://10.4.3.20:8080/v1/AUTH_ef150076a514418db3dd83cda85744d9/tempest-volumesbackupsadmintest-backup-container-2134208080?format=json&prefix=volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' (txn: tx4e023e59922d4e3abcafa-006a49deb9) Jul 05 04:34:01.515304 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] delete b86dfdb7-b0f8-4a79-a597-c9eb66b20c2e finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:01.564181 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:01.583945 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Created reservations ['421b5b30-21a0-44f4-b51c-2d3d19721580', 'b4450a8d-3b62-4b22-8597-94707f4ebfcc'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:01.610948 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-be69c697-688b-4700-b176-7d9b01e99d40 tempest-VolumesBackupsAdminTest-1192588857 None] Delete backup finished, backup b86dfdb7-b0f8-4a79-a597-c9eb66b20c2e deleted. Jul 05 04:34:02.388727 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] Delete backup started, backup: e4ac43fb-8b68-40b5-9899-91f562c73006. Jul 05 04:34:02.391428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8ffd1169d4414447b21c7c86d36a1523 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:02.391624 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:02.391838 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] delete started, backup: e4ac43fb-8b68-40b5-9899-91f562c73006, container: tempest-volumesbackupsadmintest-backup-container-2134208080, prefix: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:02.426246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] generated object list: ['volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata', 'volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:34:02.446679 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00001 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.466757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00002 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.484945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00003 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.502311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00004 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.544855 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:02.551968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00005 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.582987 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00006 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.613148 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00007 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.617513 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-7f0b5b1d-41c6-474c-a86d-4a6eb00fbd28 tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: 29bcd485-6f55-42a0-ae5c-2a8764914442. Jul 05 04:34:02.645252 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00008 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.668747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00009 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.697803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00010 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.727268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00011 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.758837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00012 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.778495 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00013 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.801708 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00014 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.828481 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00015 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.852472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00016 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.873467 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00017 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.902779 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00018 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.928751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00019 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.947968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00020 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.964714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006-00021 in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:02.985721 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_metadata in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:03.003022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_adc0fa30-aa0c-47dd-8888-cc13656b5047/20260705043330/az_nova_backup_e4ac43fb-8b68-40b5-9899-91f562c73006_sha256file in container: tempest-volumesbackupsadmintest-backup-container-2134208080. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:03.003370 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] delete e4ac43fb-8b68-40b5-9899-91f562c73006 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:03.017224 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] Created reservations ['b6a803f7-465c-4ab4-808f-8c3b186eaf5b', 'c29a10d5-8d15-424e-8ba4-fa212b32488d'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:03.031686 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a24db07b-53e6-4882-b1ca-6e4dee8bec0d tempest-VolumesBackupsAdminTest-129643724 None] Delete backup finished, backup e4ac43fb-8b68-40b5-9899-91f562c73006 deleted. Jul 05 04:34:03.447621 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: 29bcd485-6f55-42a0-ae5c-2a8764914442. Jul 05 04:34:03.450929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:03.451197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:03.451394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] delete started, backup: 29bcd485-6f55-42a0-ae5c-2a8764914442, container: volumebackups, prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:03.511579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_metadata', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:34:03.535029 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:03.562299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043353/az_nova_backup_29bcd485-6f55-42a0-ae5c-2a8764914442_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:03.562299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] delete 29bcd485-6f55-42a0-ae5c-2a8764914442 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:03.609325 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:03.624290 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] Created reservations ['a3eb1db8-f0ea-496b-ae1d-2bb243a1d005', '404da6bf-215c-465e-bd1a-747a90f8f8e5'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:03.653030 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-015de761-0fcf-41c2-84a0-6e5fab26dd34 tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup 29bcd485-6f55-42a0-ae5c-2a8764914442 deleted. Jul 05 04:34:04.601410 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Create backup started, backup: 47878626-53b2-4ab3-84ad-5844ffeec6be volume: a1a31896-6a42-484c-b5bf-d59763910b0d. Jul 05 04:34:04.606540 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-346443644',created_at=2026-07-05T04:34:04Z,data_timestamp=2026-07-05T04:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1527007539',encryption_key_id=None,fail_reason=None,host='np0000004568',id=47878626-53b2-4ab3-84ad-5844ffeec6be,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(ff270e4d-aec0-459e-b4c3-44d38067e31f),parent_id='ff270e4d-aec0-459e-b4c3-44d38067e31f',project_id='6ae5e615014a4de2b73e1686d477f623',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3332890ff7524ae593ed58751133681b',volume_id=a1a31896-6a42-484c-b5bf-d59763910b0d) Jul 05 04:34:04.664981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:04.665283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:04.665671 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:04.678367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:34:04.696923 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:04.708466 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:34:04.708818 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:34:04.720238 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:34:04.721802 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481', 'fe80::f816:3eff:fe00:c044'] Jul 05 04:34:04.721979 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:34:04.722105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:34:04.722342 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:05.226059 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:34:05.226837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:05.226837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:05.227165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:05.227346 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:34:05.239324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:05.239830 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:05.240234 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:34:05.253201 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:34:05.253201 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f] added Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:34:05.262665 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:05.262897 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:34:05.263263 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:34:05.263444 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:34:06.050817 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:06.056654 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Create backup started, backup: 4e345efb-632d-4baf-abc5-756f8728e93d volume: 26a79bf0-daa6-4662-985b-5a8393d73a2f. Jul 05 04:34:06.062827 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1354452449',created_at=2026-07-05T04:34:05Z,data_timestamp=2026-07-05T04:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-265677486',encryption_key_id=None,fail_reason=None,host='np0000004568',id=4e345efb-632d-4baf-abc5-756f8728e93d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8ffd1169d4414447b21c7c86d36a1523',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='984260d7331c4a52a01e58a8117e48fe',volume_id=26a79bf0-daa6-4662-985b-5a8393d73a2f) Jul 05 04:34:06.086213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8ffd1169d4414447b21c7c86d36a1523 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:06.086458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:06.086756 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:06.096475 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:34:06.116187 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:06.130187 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:34:06.130878 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:34:06.139099 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:34:06.140399 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:feb9:ea0a', 'fe80::4a9:baff:fe12:8f4e', 'fe80::f816:3eff:fe19:30d3', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fe0d:6edd', 'fe80::582b:39ff:fed2:ee5d', 'fe80::f816:3eff:fe22:2481', 'fe80::f816:3eff:fe00:c044', 'fe80::1038:b6ff:fed2:469e'] Jul 05 04:34:06.140595 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:34:06.141236 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:34:06.141654 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:06.264823 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:34:06.278054 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:06.289267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:06.301879 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.301879 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.301879 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.301879 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.301879 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:06.302357 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.302357 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.302357 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.302357 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.302357 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:06.344545 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f, portal: 192.168.40.100,3260] Jul 05 04:34:06.344545 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f, portal: 192.168.40.100,3260] successful. Jul 05 04:34:06.344545 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:06.354989 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:06.367217 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:06.367423 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:06.367851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:06.368149 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:34:06.368630 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] HCTL ('7', '-', '-', 0) found on session 97 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:34:06.368760 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:34:06.381618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 97 and hctl ['7', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:34:06.645054 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:34:06.645411 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26a79bf0-daa6-4662-985b-5a8393d73a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:06.645596 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:07.383336 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Searching for a device in session 97 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:34:07.383811 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:34:07.384214 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:07.384394 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] <== connect_volume: return (2157ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:07.384745 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:07.390732 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.744s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:07.391145 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26a79bf0-daa6-4662-985b-5a8393d73a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:34:07.402140 np0000004568 sudo[131355]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:34:07.402869 np0000004568 sudo[131355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:34:07.404581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:07.405082 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:07.405355 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:34:07.416074 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:34:07.416074 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f] added Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:34:07.429239 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:07.429621 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:34:07.430005 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:34:07.430326 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:34:07.773225 np0000004568 sudo[131355]: pam_unix(sudo:session): session closed for user root Jul 05 04:34:07.775292 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.390s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:34:07.836089 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:07.843898 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-370029117, sha256 filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:34:07.890475 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:34:07.898404 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _create_container started, container: tempest-volumesbackupstest-backup-container-346443644,backup: 47878626-53b2-4ab3-84ad-5844ffeec6be. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:34:07.957177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] generate_object_name_prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:34:07.962422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] starting backup of volume: a1a31896-6a42-484c-b5bf-d59763910b0d, volume size: 1073741824, object names prefix volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:34:08.431658 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:34:08.445589 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:08.456236 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:08.472598 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:08.472882 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:08.513163 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f, portal: 192.168.40.100,3260] Jul 05 04:34:08.513163 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f, portal: 192.168.40.100,3260] successful. Jul 05 04:34:08.513163 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:08.531586 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:08.552855 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:08.554888 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:08.555767 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:08.555983 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:34:08.556902 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] HCTL ('8', '-', '-', 0) found on session 98 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:34:08.557048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:34:08.581563 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Searching for a device in session 98 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:34:08.581718 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26a79bf0-daa6-4662-985b-5a8393d73a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:34:09.584463 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.194s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:09.584936 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] <== connect_volume: return (2938ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799049', 'path': '/dev/sdc'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:09.585229 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:09.642542 np0000004568 sudo[131466]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 04:34:09.645666 np0000004568 sudo[131466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:34:10.034727 np0000004568 sudo[131466]: pam_unix(sudo:session): session closed for user root Jul 05 04:34:10.039590 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.454s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:34:10.056417 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1354452449,backup: 4e345efb-632d-4baf-abc5-756f8728e93d. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:34:10.136560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] generate_object_name_prefix: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:34:10.142879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] starting backup of volume: 26a79bf0-daa6-4662-985b-5a8393d73a2f, volume size: 1073741824, object names prefix volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:34:10.427136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:10.719443 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:10.723105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:10.861652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:10.862735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:11.215529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:11.503111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:11.503351 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:11.631662 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:11.631789 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:11.941963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:12.208048 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:12.208625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:12.327540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:12.327540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:12.673686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:12.953516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:12.953516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:13.002774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:34:13.015715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:34:13.015969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:34:13.022012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:34:13.022163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:34:13.027689 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:34:13.028041 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-346443644, sha256file filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:34:13.078984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:13.078984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:13.105613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:34:13.106770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-346443644, metadata filename: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:34:13.157470 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "47878626-53b2-4ab3-84ad-5844ffeec6be",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1527007539",\n "created_at": "2026-07-05 04:34:05+00:00",\n "objects": [],\n "parent_id": "ff270e4d-aec0-459e-b4c3-44d38067e31f",\n "version": "1.0.0",\n "volume_id": "a1a31896-6a42-484c-b5bf-d59763910b0d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a1a31896-6a42-484c-b5bf-d59763910b0d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3332890ff7524ae593ed58751133681b\\", \\"project_id\\": \\"6ae5e615014a4de2b73e1686d477f623\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:32:21.000000\\", \\"launched_at\\": \\"2026-07-05T04:32:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-105740927\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:32:21.000000\\", \\"updated_at\\": \\"2026-07-05T04:34:05.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:34:13.162532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] backup 47878626-53b2-4ab3-84ad-5844ffeec6be finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:34:13.310484 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:13.340409 np0000004568 sudo[131552]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:34:13.341199 np0000004568 sudo[131552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:34:13.369350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:13.622788 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:13.623004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:13.669519 np0000004568 sudo[131552]: pam_unix(sudo:session): session closed for user root Jul 05 04:34:13.671498 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.361s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:34:13.672293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:13.672547 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:13.746798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:13.746871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:13.993514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:14.252524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:14.253237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:14.375716 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:14.375906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:14.579281 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:14.830788 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:14.831019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:14.952007 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:14.952189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:15.151267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:15.407062 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:15.407233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:15.513597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:15.513699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:15.635745 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.963s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:15.636324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb08aaef-f4e4-4696-a79f-e00a60c8950f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:15.651127 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:15.651910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:34:15.651910 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:34:15.651910 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:34:15.651910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:15.681348 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:15.681738 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:15.681967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a31896-6a42-484c-b5bf-d59763910b0d', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc', '99')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:34:15.682218 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f', '97')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:34:15.684329 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Resulting device map defaultdict(. at 0x77fdedd193a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:34:15.684905 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:34:15.699245 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:34:15.707297 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:34:15.721237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:15.758270 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:34:15.758496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:34:15.759997 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:34:15.772694 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:34:15.773065 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:34:15.785855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:15.817949 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f, portal: 192.168.40.100,3260] Jul 05 04:34:15.817949 np0000004568 cinder-backup[101263]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-bb08aaef-f4e4-4696-a79f-e00a60c8950f, portal: 192.168.40.100,3260] successful. Jul 05 04:34:15.817949 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:15.836011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:15.836451 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.201s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:15.836451 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] <== disconnect_volume: return (2163ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:15.986133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:15.986386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:16.112010 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:16.112305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:16.332428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:16.578130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:16.578321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:16.686955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:16.687174 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:16.890791 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-030d159f-a620-445b-9c17-35feb4858074 tempest-VolumesBackupsTest-1912920348 None] Create backup finished. backup: 47878626-53b2-4ab3-84ad-5844ffeec6be. Jul 05 04:34:16.916144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:17.129610 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: 47878626-53b2-4ab3-84ad-5844ffeec6be. Jul 05 04:34:17.137429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:17.137705 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:17.137984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] delete started, backup: 47878626-53b2-4ab3-84ad-5844ffeec6be, container: tempest-volumesbackupstest-backup-container-346443644, prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:17.180449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:17.180750 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:17.192965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_metadata', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:34:17.219352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_metadata in container: tempest-volumesbackupstest-backup-container-346443644. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:17.248449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043407/az_nova_backup_47878626-53b2-4ab3-84ad-5844ffeec6be_sha256file in container: tempest-volumesbackupstest-backup-container-346443644. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:17.248765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] delete 47878626-53b2-4ab3-84ad-5844ffeec6be finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:17.294526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:17.294748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:17.325191 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:17.350547 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] Created reservations ['0f79bf08-66f4-4fe4-89fe-9d24095bb41a', '27e9dccf-0779-419d-a478-a7155565ad74'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:17.392164 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-35410a63-6928-4e28-ad8c-b0ffb706f36b tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup 47878626-53b2-4ab3-84ad-5844ffeec6be deleted. Jul 05 04:34:17.533634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:17.802210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:17.802441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:17.904054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:17.904250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:18.103683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:18.323052 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] Delete backup started, backup: ff270e4d-aec0-459e-b4c3-44d38067e31f. Jul 05 04:34:18.331473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6ae5e615014a4de2b73e1686d477f623 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:18.331749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:18.332030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] delete started, backup: ff270e4d-aec0-459e-b4c3-44d38067e31f, container: tempest-volumesbackupstest-backup-container-370029117, prefix: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:18.372733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:18.372733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:18.375888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] generated object list: ['volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00001', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00002', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00003', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00004', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00005', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00006', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00007', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00008', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00009', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00010', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00011', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00012', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00013', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00014', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00015', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00016', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00017', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00018', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00019', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00020', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00021', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_metadata', 'volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:34:18.403681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00001 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.427821 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00002 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.455996 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00003 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.481123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00004 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.484860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:18.484996 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:18.518814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00005 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.527692 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:18.543266 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00006 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.568898 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00007 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.598422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00008 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.622849 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00009 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.649050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00010 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.676083 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00011 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.703011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00012 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.731443 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00013 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.750400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:18.757567 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00014 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.780908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00015 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.805801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00016 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.830719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00017 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.851107 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00018 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.874859 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00019 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.896236 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00020 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.915751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f-00021 in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.934858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_metadata in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.956399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] deleted object: volume_a1a31896-6a42-484c-b5bf-d59763910b0d/20260705043332/az_nova_backup_ff270e4d-aec0-459e-b4c3-44d38067e31f_sha256file in container: tempest-volumesbackupstest-backup-container-370029117. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:18.956748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] delete ff270e4d-aec0-459e-b4c3-44d38067e31f finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:18.958782 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=218,cinder:UPDATE=60,cinder:INSERT=9 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:34:18.976556 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] Created reservations ['578b67be-7f71-4bcc-b363-9ec8143282f5', 'd218d7fd-d240-4c58-9207-73490a634d8a'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:18.993113 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d10bbd8f-095a-4ba9-99c6-72f52380df9a tempest-VolumesBackupsTest-1912920348 None] Delete backup finished, backup ff270e4d-aec0-459e-b4c3-44d38067e31f deleted. Jul 05 04:34:18.997101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:18.997299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:19.101269 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:19.101535 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:19.327110 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:19.593037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:19.593037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:19.719564 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:19.719735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:19.924808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:20.190162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:20.190406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:20.300506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:20.300691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:20.525187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:20.807491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:20.808014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:20.956484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:20.956664 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:21.187233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:21.485508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:21.486414 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:21.596178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:21.596345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:21.797047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:22.051172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:22.054684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:22.163629 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:22.163751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:22.368598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:22.638633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:22.638633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:22.744899 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:22.746604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:22.873974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:34:23.001420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:34:23.002044 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:34:23.083910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup MD5 for volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:34:23.083910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:34:23.090622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:34:23.097416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:34:23.097767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:34:23.105016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:34:23.105016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:34:23.109676 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:34:23.110896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1354452449, sha256file filename: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:34:23.175805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:34:23.176764 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1354452449, metadata filename: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:34:23.227050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "4e345efb-632d-4baf-abc5-756f8728e93d",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-265677486",\n "created_at": "2026-07-05 04:34:06+00:00",\n "objects": [\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "26a79bf0-daa6-4662-985b-5a8393d73a2f",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"26a79bf0-daa6-4662-985b-5a8393d73a2f\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"984260d7331c4a52a01e58a8117e48fe\\", \\"project_id\\": \\"8ffd1169d4414447b21c7c86d36a1523\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:34:05.000000\\", \\"launched_at\\": \\"2026-07-05T04:34:05.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1456862704\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:34:05.000000\\", \\"updated_at\\": \\"2026-07-05T04:34:06.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:34:23.233843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] backup 4e345efb-632d-4baf-abc5-756f8728e93d finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:34:23.381098 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:34:23.399542 np0000004568 sudo[131960]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 04:34:23.400203 np0000004568 sudo[131960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:34:23.750080 np0000004568 sudo[131960]: pam_unix(sudo:session): session closed for user root Jul 05 04:34:23.752418 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.371s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:34:23.753446 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26a79bf0-daa6-4662-985b-5a8393d73a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799049', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:34:23.753784 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:34:23.754822 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:34:23.755639 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26a79bf0-daa6-4662-985b-5a8393d73a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:34:23.771411 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:34:23.772263 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:23.798386 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b (non-flash) Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f (non-flash) Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc (non-flash) Jul 05 04:34:23.798611 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:34:23.798814 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c568c8e-5f82-4797-b78f-1b8ea5e2ce5b', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a018e0b-1062-4cb5-9a6a-fcf6124d30bc', '99')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:34:23.799030 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f', '98')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:34:23.800290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Resulting device map defaultdict(. at 0x77fe0c6393a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f'): ({'sdc'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:34:23.800579 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Removing single pathed devices sdc {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:34:23.814332 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Flushing IO for device /dev/sdc {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:34:23.826381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:34:23.894962 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:34:23.895126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:34:23.896210 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:34:23.909936 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:34:23.910250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:34:23.921395 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:23.950320 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f, portal: 192.168.40.100,3260] Jul 05 04:34:23.950320 np0000004568 cinder-backup[101263]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-26a79bf0-daa6-4662-985b-5a8393d73a2f, portal: 192.168.40.100,3260] successful. Jul 05 04:34:23.950320 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:23.963931 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:34:23.964520 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.210s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:34:23.964610 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] <== disconnect_volume: return (210ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:34:24.994179 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-edf5fc5f-e14e-44a4-928d-154ac8eb257f tempest-VolumesBackupsAdminTest-129643724 None] Create backup finished. backup: 4e345efb-632d-4baf-abc5-756f8728e93d. Jul 05 04:34:25.620943 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4119320b-aecd-4e69-8760-d1e1d0b9ffe4 tempest-VolumesBackupsAdminTest-1192588857 None] Reset backup status started, backup_id: 4e345efb-632d-4baf-abc5-756f8728e93d, status: error. Jul 05 04:34:25.620943 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4119320b-aecd-4e69-8760-d1e1d0b9ffe4 tempest-VolumesBackupsAdminTest-1192588857 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 05 04:34:25.679796 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] Delete backup started, backup: 4e345efb-632d-4baf-abc5-756f8728e93d. Jul 05 04:34:25.684279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8ffd1169d4414447b21c7c86d36a1523 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:34:25.684449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:34:25.684646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] delete started, backup: 4e345efb-632d-4baf-abc5-756f8728e93d, container: tempest-volumesbackupsadmintest-backup-container-1354452449, prefix: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:34:25.745968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] generated object list: ['volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00001', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00002', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00003', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00004', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00005', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00006', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00007', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00008', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00009', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00010', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00011', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00012', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00013', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00014', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00015', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00016', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00017', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00018', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00019', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00020', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00021', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_metadata', 'volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:34:25.773628 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00001 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.792924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00002 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.818061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00003 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.846913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00004 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.869639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00005 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.896402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00006 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.917914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00007 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.940658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00008 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:25.966796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00009 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.004894 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00010 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.027524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00011 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.050101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00012 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.079633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00013 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.106387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00014 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.130249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00015 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.152411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00016 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.176450 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00017 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.201552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00018 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.225383 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00019 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.248379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00020 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.269782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d-00021 in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.291135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_metadata in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.312716 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] deleted object: volume_26a79bf0-daa6-4662-985b-5a8393d73a2f/20260705043410/az_nova_backup_4e345efb-632d-4baf-abc5-756f8728e93d_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1354452449. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:34:26.313027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] delete 4e345efb-632d-4baf-abc5-756f8728e93d finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:34:26.355627 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:34:26.371928 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] Created reservations ['fe2bc8ba-82de-48ae-a272-7ec5d6121dff', 'f025df50-9350-47e1-9127-3f30c2476c5f'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:34:26.388134 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-39887e7a-2a3d-4284-8bcc-e92b9e75e8aa tempest-VolumesBackupsAdminTest-129643724 None] Delete backup finished, backup 4e345efb-632d-4baf-abc5-756f8728e93d deleted. Jul 05 04:34:36.384949 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=16 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:35:00.280754 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:35:00.281214 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:35:37.260977 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:36:00.278993 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:36:00.279505 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:36:41.829615 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Create backup started, backup: b06f881d-13d7-4685-a1dd-d1645173aa0d volume: 4adb16ee-4d13-4c02-a71c-057888ea44b7. Jul 05 04:36:41.835798 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:36:41Z,data_timestamp=2026-07-05T04:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1454640991',encryption_key_id=None,fail_reason=None,host='np0000004568',id=b06f881d-13d7-4685-a1dd-d1645173aa0d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='54d18d9011264c4c8ea512094609bdd8',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='29a9b1baae9240ec94ec3a14d43774f0',volume_id=4adb16ee-4d13-4c02-a71c-057888ea44b7) Jul 05 04:36:41.865757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:36:41.865972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:36:41.866321 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:36:41.875988 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:36:41.894131 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:36:41.905696 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:36:41.905696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:36:41.913726 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:36:41.914940 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe72:ad07', 'fe80::9866:adff:fe81:246e', 'fe80::f816:3eff:fe63:d3e9', 'fe80::84ae:eeff:fe9c:11ba', 'fe80::f816:3eff:fe55:6b20', 'fe80::f816:3eff:fe5f:bce0', 'fe80::e4c9:d1ff:fe2b:4bef'] Jul 05 04:36:41.915162 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:36:41.915337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:36:41.915621 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:36:42.419961 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:36:42.420391 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4adb16ee-4d13-4c02-a71c-057888ea44b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:36:42.420598 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:36:51.117531 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 8.697s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:36:51.117901 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4adb16ee-4d13-4c02-a71c-057888ea44b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:36:51.129341 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:36:51.129848 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:36:51.130062 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:36:51.139997 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:36:51.139997 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7] added Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:36:51.151517 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:51.152734 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:36:51.153298 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:36:51.153504 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:36:51.858923 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:36:52.154500 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:36:52.165602 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:52.178509 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.192773 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.193105 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:36:52.242241 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7, portal: 192.168.40.100,3260] Jul 05 04:36:52.242241 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7, portal: 192.168.40.100,3260] successful. Jul 05 04:36:52.242241 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:52.252886 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 (non-flash) Jul 05 04:36:52.269502 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-987ef006-eb45-41d4-9831-5fd1aa7350cc (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e6eba29-a61d-405e-8d3b-d561a5b81f9d (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccbf2fab-5380-4b9a-999e-99347c4ebea2 (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 (non-flash) Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:36:52.270277 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:36:52.271440 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] HCTL ('15', '-', '-', 0) found on session 135 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:36:52.271586 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:36:52.286346 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Searching for a device in session 135 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:36:52.287810 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4adb16ee-4d13-4c02-a71c-057888ea44b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:36:53.290792 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.173s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:36:53.291722 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] <== connect_volume: return (10870ms) {'type': 'block', 'scsi_wwn': '330000000e99ecf0e', 'path': '/dev/sdj'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:36:53.294502 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:36:53.314930 np0000004568 sudo[138731]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 05 04:36:53.315538 np0000004568 sudo[138731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:36:53.655638 np0000004568 sudo[138731]: pam_unix(sudo:session): session closed for user root Jul 05 04:36:53.657594 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.365s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:36:53.704808 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:36:53.712628 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _create_container started, container: volumebackups,backup: b06f881d-13d7-4685-a1dd-d1645173aa0d. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:36:53.969790 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] generate_object_name_prefix: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:36:53.976475 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] starting backup of volume: 4adb16ee-4d13-4c02-a71c-057888ea44b7, volume size: 1073741824, object names prefix volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:36:54.206441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:54.478807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:54.479226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:54.615447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:54.615640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:54.829283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:55.082750 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:55.082935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:55.209105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:55.209271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:55.462743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:55.719214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:55.719214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:55.840306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:55.840496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:56.069992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:56.336343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:56.336546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:56.463515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:56.463717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:56.666926 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:56.945409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:56.945769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:57.056759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:57.056948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:57.268672 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:57.547468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:57.547748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:57.666904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:57.667140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:57.905254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:58.171871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:58.171871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:58.287587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:58.287808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:58.484258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:58.747897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:58.748146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:58.856424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:58.856656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:59.069061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:59.329440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:59.329821 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:36:59.442069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:36:59.442287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:36:59.685100 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:36:59.951254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:36:59.951254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:00.080743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:00.080913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:00.288253 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:37:00.288639 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:37:00.335892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:00.584376 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:00.584630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:00.704552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:00.704794 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:00.905584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:01.154319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:01.154446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:01.268207 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:01.268409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:01.485086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:01.767191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:01.767384 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:01.885432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:01.885668 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:02.083555 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:02.346027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:02.346195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:02.456020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:02.456244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:02.681139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:02.930977 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:02.933976 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:03.050940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:03.051173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:03.256550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:03.497868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:03.498044 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:03.619860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:03.620067 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:03.856627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:04.121407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:04.121609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:04.229598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:04.229798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:04.433855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:05.166604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:05.166604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:05.166604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:05.166604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:05.166604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:05.290786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:05.291073 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:05.407121 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:05.407283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:05.611369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:05.864973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:05.865125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:05.970935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:05.971128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:06.064468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:06.186008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:06.186279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:06.249043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:06.249204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:06.256858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:37:06.262254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:37:06.262402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:37:06.265872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:37:06.266031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:37:06.273602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:37:06.273753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:37:06.342524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:37:06.345477 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _write_metadata started, container name: volumebackups, metadata filename: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:37:06.384544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b06f881d-13d7-4685-a1dd-d1645173aa0d",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1454640991",\n "created_at": "2026-07-05 04:36:42+00:00",\n "objects": [\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4adb16ee-4d13-4c02-a71c-057888ea44b7",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4adb16ee-4d13-4c02-a71c-057888ea44b7\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:36:41.000000\\", \\"launched_at\\": \\"2026-07-05T04:36:41.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1839984600\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:36:41.000000\\", \\"updated_at\\": \\"2026-07-05T04:36:42.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:37:06.396147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] backup b06f881d-13d7-4685-a1dd-d1645173aa0d finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:37:06.518847 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:06.536857 np0000004568 sudo[138950]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 05 04:37:06.537552 np0000004568 sudo[138950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:06.891295 np0000004568 sudo[138950]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:06.893278 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.374s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:06.894041 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4adb16ee-4d13-4c02-a71c-057888ea44b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e99ecf0e', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:06.894291 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:06.894886 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:06.895304 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4adb16ee-4d13-4c02-a71c-057888ea44b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:06.906396 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:06.906931 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:37:06.906931 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:37:06.906931 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:37:06.907150 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:37:06.931875 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:06.931875 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:06.931875 np0000004568 cinder-backup[101263]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 (non-flash) Jul 05 04:37:06.931875 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:06.932057 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:06.932057 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:06.932057 np0000004568 cinder-backup[101263]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7 (non-flash) Jul 05 04:37:06.932057 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:06.932241 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', '135')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:37:06.932380 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7', '135')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:37:06.933258 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Resulting device map defaultdict(. at 0x77fe0c6393a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7'): ({'sdj'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:37:06.933492 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Removing single pathed devices sdj {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:37:06.944191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Flushing IO for device /dev/sdj {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:37:06.951866 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:37:06.996480 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:37:06.996643 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] SCSI volumes sdj have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:37:06.997608 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:37:07.012313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:37:07.012313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:37:07.026919 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:07.053033 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7, portal: 192.168.40.100,3260] Jul 05 04:37:07.053033 np0000004568 cinder-backup[101263]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-4adb16ee-4d13-4c02-a71c-057888ea44b7, portal: 192.168.40.100,3260] successful. Jul 05 04:37:07.053033 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:07.068696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:07.068975 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.174s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:07.069151 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] <== disconnect_volume: return (174ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:08.096452 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-62a94696-f56d-4fbc-8e62-50cbf705ebf7 tempest-VolumesBackupsTest-1237731642 None] Create backup finished. backup: b06f881d-13d7-4685-a1dd-d1645173aa0d. Jul 05 04:37:08.638630 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] Delete backup started, backup: b06f881d-13d7-4685-a1dd-d1645173aa0d. Jul 05 04:37:08.648702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:08.648945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:08.649186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] delete started, backup: b06f881d-13d7-4685-a1dd-d1645173aa0d, container: volumebackups, prefix: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:37:08.689162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] generated object list: ['volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00001', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00002', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00003', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00004', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00005', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00006', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00007', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00008', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00009', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00010', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00011', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00012', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00013', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00014', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00015', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00016', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00017', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00018', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00019', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00020', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00021', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_metadata', 'volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:37:08.707145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.724019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.739956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.756721 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.773222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.791474 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.810017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.827941 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.845483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.864185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.883792 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.900875 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.919303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.938306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.956978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.976171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:08.996945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.017019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.038554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.056292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.075018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.093013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.109200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_4adb16ee-4d13-4c02-a71c-057888ea44b7/20260705043653/az_nova_backup_b06f881d-13d7-4685-a1dd-d1645173aa0d_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:09.109503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] delete b06f881d-13d7-4685-a1dd-d1645173aa0d finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:37:09.140898 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:09.152983 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] Created reservations ['786dc87b-3537-4ab0-b8e7-8c411f1d6397', '2f60a27b-b517-4b69-878f-0f57f7657a63'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:37:09.164916 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d4adab66-cfc6-4d22-b5b6-57df3c69219e tempest-VolumesBackupsTest-1237731642 None] Delete backup finished, backup b06f881d-13d7-4685-a1dd-d1645173aa0d deleted. Jul 05 04:37:10.968727 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Create backup started, backup: 0126ff25-9a13-4bbd-8599-0ba8c3c51a71 volume: 62979e60-12ef-4c6c-9931-d8e176c1849a. Jul 05 04:37:10.973508 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:37:10Z,data_timestamp=2026-07-05T04:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1377297794',encryption_key_id=None,fail_reason=None,host='np0000004568',id=0126ff25-9a13-4bbd-8599-0ba8c3c51a71,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3df437545ab1476e975d9fb89b84e681',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='360f5b8a81a842d7943d78f3a4896a77',volume_id=62979e60-12ef-4c6c-9931-d8e176c1849a) Jul 05 04:37:10.999787 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:11.000215 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:11.000723 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:11.013522 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:37:11.034527 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:11.048853 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:37:11.049170 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:37:11.056633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:37:11.057743 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe63:d3e9', 'fe80::84ae:eeff:fe9c:11ba', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe28:686c', 'fe80::a84b:31ff:fefc:bc'] Jul 05 04:37:11.057919 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:37:11.058060 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:37:11.058294 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:11.562167 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:37:11.562540 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62979e60-12ef-4c6c-9931-d8e176c1849a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:11.562754 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:11.563180 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:11.563383 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62979e60-12ef-4c6c-9931-d8e176c1849a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:37:11.572795 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:11.573138 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:11.573331 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:11.581967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:37:11.581967 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a] added Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:11.592111 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:11.592338 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:37:11.592835 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0193(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:37:11.593098 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:37:12.594460 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:37:12.604400 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:12.613726 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:12.624879 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.624879 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.624879 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:12.625043 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.625043 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.625043 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:12.657300 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a, portal: 192.168.40.100,3260] Jul 05 04:37:12.657300 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a, portal: 192.168.40.100,3260] successful. Jul 05 04:37:12.657300 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:12.668435 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:12.678384 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.678384 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.678384 np0000004568 cinder-backup[101263]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a (non-flash) Jul 05 04:37:12.678384 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:12.678513 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.678513 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:12.678513 np0000004568 cinder-backup[101263]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a (non-flash) Jul 05 04:37:12.678513 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:12.678819 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.106s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:12.678949 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:37:12.679439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] HCTL ('9', '-', '-', 0) found on session 136 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:37:12.679558 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:37:12.691762 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Searching for a device in session 136 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:12.691916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62979e60-12ef-4c6c-9931-d8e176c1849a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:37:13.694649 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.131s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:13.694959 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] <== connect_volume: return (2132ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799083', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:13.695159 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:13.717003 np0000004568 sudo[139077]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:37:13.717815 np0000004568 sudo[139077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:14.008428 np0000004568 sudo[139077]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:14.010410 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.315s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:14.044775 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:14.054138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _create_container started, container: volumebackups,backup: 0126ff25-9a13-4bbd-8599-0ba8c3c51a71. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:37:14.252042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] generate_object_name_prefix: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:37:14.256327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] starting backup of volume: 62979e60-12ef-4c6c-9931-d8e176c1849a, volume size: 1073741824, object names prefix volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:37:14.433103 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:14.694915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:14.695303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:14.799558 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:14.799804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:14.999372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:15.264400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:15.264670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:15.373221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:15.373407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:15.627991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:15.917799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:15.918200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:16.025000 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:16.025190 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:16.221227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:16.468993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:16.469131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:16.576024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:16.576172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:16.764849 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:17.037009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:17.037009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:17.143209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:17.143401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:17.337829 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:17.591895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:17.592112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:17.702814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:17.702993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:17.933754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:18.207982 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:18.207982 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:18.314119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:18.314363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:18.510983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:18.768507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:18.768507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:18.882502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:18.882764 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:19.086658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:19.329687 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:19.330133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:19.429147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:19.429310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:19.616330 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:19.874980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:19.874980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:19.978729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:19.978729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:20.180409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:20.430315 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:20.430791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:20.535206 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:20.535404 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:20.766206 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:21.011583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:21.011583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:21.123703 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:21.123837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:21.331194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:21.590009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:21.590506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:21.711247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:21.711247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:21.938402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:22.195820 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:22.195987 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:22.308600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:22.308816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:22.537472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:22.790500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:22.790895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:22.899906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:22.900145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:23.112669 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:23.364039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:23.364039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:23.479155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:23.479319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:23.704201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:23.992886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:23.993282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:24.095778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:24.096035 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:24.336680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:24.589199 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:24.589385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:24.697921 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:24.698100 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:24.940725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:25.189280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:25.189667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:25.309670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:25.309862 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:25.510022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:25.777882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:25.778074 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:25.887336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:25.887336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:25.993135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:26.120054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:26.120054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:26.182152 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:26.182500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:26.190693 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:37:26.197054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:37:26.197361 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:37:26.202637 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:37:26.203317 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:37:26.206108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:37:26.209586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:37:26.271471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:37:26.271471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _write_metadata started, container name: volumebackups, metadata filename: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:37:26.298858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0126ff25-9a13-4bbd-8599-0ba8c3c51a71",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1377297794",\n "created_at": "2026-07-05 04:37:11+00:00",\n "objects": [\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "62979e60-12ef-4c6c-9931-d8e176c1849a",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"62979e60-12ef-4c6c-9931-d8e176c1849a\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:10.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1823366641\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:10.000000\\", \\"updated_at\\": \\"2026-07-05T04:37:11.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:37:26.306134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] backup 0126ff25-9a13-4bbd-8599-0ba8c3c51a71 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:37:26.448743 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:26.470794 np0000004568 sudo[139470]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:37:26.471617 np0000004568 sudo[139470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:26.768151 np0000004568 sudo[139470]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:26.770160 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.321s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:26.770847 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62979e60-12ef-4c6c-9931-d8e176c1849a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799083', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:26.771062 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:26.771582 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:26.771991 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62979e60-12ef-4c6c-9931-d8e176c1849a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:26.782779 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:26.783277 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:37:26.783277 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:37:26.783277 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:37:26.783277 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '138')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:37:26.812564 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a', '136')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:37:26.813376 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Resulting device map defaultdict(. at 0x77fe0bfe2700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:37:26.813376 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:37:26.824817 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:37:26.833472 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:37:26.902129 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:37:26.902313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:37:26.904189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:37:26.914373 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:37:26.914658 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:37:26.926727 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:26.955802 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a, portal: 192.168.40.100,3260] Jul 05 04:37:26.955802 np0000004568 cinder-backup[101263]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-62979e60-12ef-4c6c-9931-d8e176c1849a, portal: 192.168.40.100,3260] successful. Jul 05 04:37:26.955802 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:26.971514 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:26.971863 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.200s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:26.972063 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] <== disconnect_volume: return (201ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:27.992803 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-e2c84447-6a43-4460-ace4-3d508364d43b tempest-VolumesBackupsTest-450201696 None] Create backup finished. backup: 0126ff25-9a13-4bbd-8599-0ba8c3c51a71. Jul 05 04:37:28.450127 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] Delete backup started, backup: 0126ff25-9a13-4bbd-8599-0ba8c3c51a71. Jul 05 04:37:28.458551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:28.458985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:28.459284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] delete started, backup: 0126ff25-9a13-4bbd-8599-0ba8c3c51a71, container: volumebackups, prefix: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:37:28.502231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] generated object list: ['volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00001', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00002', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00003', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00004', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00005', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00006', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00007', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00008', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00009', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00010', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00011', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00012', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00013', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00014', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00015', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00016', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00017', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00018', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00019', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00020', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00021', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_metadata', 'volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:37:28.528288 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.550332 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.574688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.600366 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.623714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.646552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.670089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.690454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.712905 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.738204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.763194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.790759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.815222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.839248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.865125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.899231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.920343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.938881 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.962432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:28.984415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:29.015582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:29.037064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:29.066840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_62979e60-12ef-4c6c-9931-d8e176c1849a/20260705043714/az_nova_backup_0126ff25-9a13-4bbd-8599-0ba8c3c51a71_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:29.067158 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] delete 0126ff25-9a13-4bbd-8599-0ba8c3c51a71 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:37:29.123970 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:29.145954 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] Created reservations ['a5330e46-46e5-40da-ac48-9d9bdedec582', 'd7ffdc2e-1374-4f1e-83ae-9aac58734776'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:37:29.170358 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ad8c34c5-6a6d-4661-9e35-1946fac671a4 tempest-VolumesBackupsTest-450201696 None] Delete backup finished, backup 0126ff25-9a13-4bbd-8599-0ba8c3c51a71 deleted. Jul 05 04:37:30.866761 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Create backup started, backup: d4d78b36-6949-45e8-91fa-f46da20558cf volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591. Jul 05 04:37:30.875241 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:37:30Z,data_timestamp=2026-07-05T04:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-504962766',encryption_key_id=None,fail_reason=None,host='np0000004568',id=d4d78b36-6949-45e8-91fa-f46da20558cf,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3df437545ab1476e975d9fb89b84e681',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='360f5b8a81a842d7943d78f3a4896a77',volume_id=b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591) Jul 05 04:37:30.902727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:30.903127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:30.903561 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:30.913845 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:37:30.934174 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:30.947608 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:37:30.947958 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:37:30.955590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:37:30.956937 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe28:686c', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13'] Jul 05 04:37:30.957290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:37:30.957520 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:37:30.957914 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:31.462290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:37:31.462851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:31.462993 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:31.463550 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:31.463826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:37:31.475923 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:31.476504 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:31.476748 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:31.486591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:37:31.486591 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591] added Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:31.497360 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:31.497731 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:37:31.498041 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:37:31.498268 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:37:32.499277 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:37:32.510960 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:32.524762 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:32.537587 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.537587 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.537587 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.537587 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.537587 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:32.537870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.537870 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.537870 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.537870 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.537870 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:32.574267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:37:32.574267 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:37:32.574267 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:32.584184 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:32.600801 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:32.601097 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:32.601351 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:32.601494 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:37:32.602489 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] HCTL ('9', '-', '-', 0) found on session 139 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:37:32.602697 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:37:32.617321 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Searching for a device in session 139 and hctl ['9', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:33.621594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Searching for a device in session 139 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:33.621594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:37:33.621594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.156s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:33.621594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] <== connect_volume: return (2157ms) {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:33.621594 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:33.640704 np0000004568 sudo[139581]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:37:33.641376 np0000004568 sudo[139581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:33.983628 np0000004568 sudo[139581]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:33.985696 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.365s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:34.030907 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:34.037861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _create_container started, container: volumebackups,backup: d4d78b36-6949-45e8-91fa-f46da20558cf. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:37:34.070359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] generate_object_name_prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:37:34.074940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] starting backup of volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, volume size: 1073741824, object names prefix volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:37:34.266003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:34.543844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:34.543985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:34.654070 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:34.654503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:34.862274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:35.115864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:35.116057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:35.223395 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:35.223581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:35.408470 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:35.648326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:35.648488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:35.747591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:35.748214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:35.949017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:36.204327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:36.204537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:36.320635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:36.320819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:36.520918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:36.761138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:36.761548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:36.860491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:36.860697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:37.059514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:37.318138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:37.318476 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:37.416924 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Create backup started, backup: 9ab75e80-5f50-483e-b40c-590bd1d8c182 volume: 081e351d-d5a0-4847-adac-e633088256be snapshot: 9b60c756-342c-425e-bcf2-2558e5a28af9. Jul 05 04:37:37.419952 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:37.420166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:37.450556 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-157169470',created_at=2026-07-05T04:37:37Z,data_timestamp=2026-07-05T04:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1313140847',encryption_key_id=None,fail_reason=None,host='np0000004568',id=9ab75e80-5f50-483e-b40c-590bd1d8c182,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='005ce52fa061412f80fcbd07a9c69c05',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='9b60c756-342c-425e-bcf2-2558e5a28af9',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dfdef281010046628d54e944d48905b1',volume_id=081e351d-d5a0-4847-adac-e633088256be) Jul 05 04:37:37.505107 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_005ce52fa061412f80fcbd07a9c69c05 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:37.505293 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:37.505648 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:37.523677 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:37:37.547613 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:37.571280 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:37:37.571738 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:37:37.579450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:37:37.580479 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe28:686c', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13'] Jul 05 04:37:37.580671 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:37:37.580799 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:37:37.581198 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:37.684964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:37.927202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:37.927804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:38.030483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:38.030744 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:38.068582 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:38.085215 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:37:38.085736 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5fbddda-d114-40f8-a495-39391e2d0d0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:38.085946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:38.096899 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.011s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:38.097202 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5fbddda-d114-40f8-a495-39391e2d0d0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:37:38.110172 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:38.110696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:38.111001 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:38.121230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:37:38.121230 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b] added Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:38.136823 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:38.137098 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:37:38.137444 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:37:38.137684 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:37:38.270297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:38.518008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:38.518116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:38.613022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:38.613062 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:38.810635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:39.069240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:39.069585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:39.142507 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:37:39.154966 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:39.168804 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:39.172210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:39.172210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.185343 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.185744 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:39.229384 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b, portal: 192.168.40.100,3260] Jul 05 04:37:39.229384 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b, portal: 192.168.40.100,3260] successful. Jul 05 04:37:39.229384 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:39.241951 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:39.263324 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08491e62-0d39-4bb4-99e5-d94b71dbe3c3 (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:39.263777 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:39.264003 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:39.264855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:37:39.266395 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] HCTL ('14', '-', '-', 0) found on session 142 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:37:39.266594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:37:39.285462 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Searching for a device in session 142 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:39.285769 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5fbddda-d114-40f8-a495-39391e2d0d0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:37:39.365882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:39.613351 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:39.613502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:39.718381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:39.718507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:39.924999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:40.173065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:40.173434 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:40.278907 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:40.279056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:40.295678 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.198s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:40.295837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] <== connect_volume: return (2210ms) {'type': 'block', 'scsi_wwn': '330000000ddfc8a0b', 'path': '/dev/sdi'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:40.296716 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:40.318134 np0000004568 sudo[139827]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 05 04:37:40.318758 np0000004568 sudo[139827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:40.505068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:40.614757 np0000004568 sudo[139827]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:40.616406 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.320s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:40.624252 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-157169470,backup: 9ab75e80-5f50-483e-b40c-590bd1d8c182. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:37:40.697153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] generate_object_name_prefix: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:37:40.702061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] starting backup of volume: 081e351d-d5a0-4847-adac-e633088256be, volume size: 1073741824, object names prefix volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:37:40.760589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:40.760780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:40.861760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:40.861932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:40.901860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:41.048484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:41.149747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:41.150005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:41.261540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:41.261799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:41.289402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:41.289581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:41.407634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:41.407634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:41.462762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:41.626254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:41.715686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:41.715929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:41.829022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:41.829202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:41.878385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:41.878552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:41.981380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:41.981534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:42.040783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:42.172088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:42.292056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:42.292438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:42.393635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:42.393834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:42.419489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:42.419680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:42.521502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:42.521684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:42.618488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:42.733603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:42.873030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:42.873228 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:42.976211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:42.976344 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:42.976913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:42.977092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:43.080698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:43.080698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:43.227202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:43.333760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:43.502843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:43.502843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:43.589482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:43.589748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:43.605228 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:43.605367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:43.690700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:43.690881 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:43.924998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:43.988729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:44.170482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:44.170725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:44.226675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:44.226778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:44.268225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:44.268353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:44.322882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:44.323047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:44.483363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:44.537307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:44.727018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:44.727199 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:44.777271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:44.777374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:44.832888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:44.833142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:44.897394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:44.897466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:45.089937 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:45.145056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:45.336135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:45.336348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:45.404517 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:45.404714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:45.444562 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:45.444779 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:45.509585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:45.510009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:45.658179 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:45.682467 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:45.772922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:45.773092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:45.838983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:45.839271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:45.846583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:37:45.853286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:37:45.853508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:37:45.857165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:37:45.857346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:37:45.860146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:37:45.860428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:37:45.916609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:37:45.917289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:37:45.924180 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:45.924445 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:45.941518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "d4d78b36-6949-45e8-91fa-f46da20558cf",\n "backup_name": "tempest-VolumesBackupsTest-Backup-504962766",\n "created_at": "2026-07-05 04:37:31+00:00",\n "objects": [\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:30.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1742743827\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:30.000000\\", \\"updated_at\\": \\"2026-07-05T04:37:31.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:37:45.947086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] backup d4d78b36-6949-45e8-91fa-f46da20558cf finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:37:46.065259 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:46.084069 np0000004568 sudo[140132]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:37:46.084710 np0000004568 sudo[140132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:46.147316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:46.147522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:46.332677 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:46.362945 np0000004568 sudo[140132]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:46.364670 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.299s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:46.365267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:46.365488 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:46.573891 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:46.574300 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:46.676997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:46.677187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:46.882594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:46.920810 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.554s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:46.920810 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:37:46.934230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '139')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Resulting device map defaultdict(. at 0x77fdedd36480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:37:46.962354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:37:46.971806 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:37:46.980926 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:37:47.029585 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:37:47.029585 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:37:47.029585 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:37:47.040693 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:37:47.040693 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:37:47.053362 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:47.085700 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:37:47.085700 np0000004568 cinder-backup[101263]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:37:47.085700 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:47.100080 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:47.102139 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:47.102139 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] <== disconnect_volume: return (735ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:47.120865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:47.120865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:47.224141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:47.224141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:47.405852 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:47.651892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:47.651892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:47.757582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:47.757778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:47.965267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:48.123813 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-aa8031a5-0ae0-43df-8d17-c6b309413001 tempest-VolumesBackupsTest-450201696 None] Create backup finished. backup: d4d78b36-6949-45e8-91fa-f46da20558cf. Jul 05 04:37:48.207013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:48.207013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:48.313685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:48.315912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:48.434990 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Create backup started, backup: 01de51e5-e7eb-47cc-afc5-e6f643471f84 volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591. Jul 05 04:37:48.440251 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:37:48Z,data_timestamp=2026-07-05T04:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-11252197',encryption_key_id=None,fail_reason=None,host='np0000004568',id=01de51e5-e7eb-47cc-afc5-e6f643471f84,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='54d18d9011264c4c8ea512094609bdd8',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='29a9b1baae9240ec94ec3a14d43774f0',volume_id=b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591) Jul 05 04:37:48.476402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:48.476800 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:48.477297 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:48.487034 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:37:48.507590 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:48.522382 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:37:48.522832 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:37:48.524963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:48.530293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:37:48.531822 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe28:686c', 'fe80::a84b:31ff:fefc:bc', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13', 'fe80::f816:3eff:fe33:f482', 'fe80::39:7aff:fe8f:2f91'] Jul 05 04:37:48.532254 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:37:48.532534 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:37:48.532947 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:48.762309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:48.762743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:48.861762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:48.861921 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:48.911023 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:49.042043 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:37:49.042546 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:49.042814 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:49.043364 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:49.043618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:37:49.055145 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:49.055622 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:49.055852 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:49.065353 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:37:49.065353 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591] added Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:37:49.076020 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:49.076189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:37:49.076609 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:37:49.076830 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:37:49.086303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:49.336980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:49.337095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:49.436920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:49.437098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:49.621774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:49.867435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:49.867779 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:49.976088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:49.976250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:50.079641 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:37:50.093877 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:50.110191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.131744 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:50.189433 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:37:50.189433 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:37:50.189433 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:50.203128 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:50.216241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:37:50.219826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] HCTL ('9', '-', '-', 0) found on session 145 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:37:50.220667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:37:50.234395 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:50.476239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:50.476441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:50.573187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:50.573392 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:50.743817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:50.987068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:50.987527 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:51.096231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:51.096393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:51.234333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:37:51.234611 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:37:51.235308 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.192s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:51.235548 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] <== connect_volume: return (2192ms) {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:51.235919 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:51.262562 np0000004568 sudo[140361]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:37:51.263181 np0000004568 sudo[140361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:51.304109 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:51.554046 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:51.554182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:51.583740 np0000004568 sudo[140361]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:51.585521 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.349s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:51.595970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _create_container started, container: volumebackups,backup: 01de51e5-e7eb-47cc-afc5-e6f643471f84. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:37:51.632501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] generate_object_name_prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:37:51.638296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] starting backup of volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, volume size: 1073741824, object names prefix volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:37:51.671116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:51.671353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:51.983857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:51.999387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:52.238516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:52.238773 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:52.263292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:52.263597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:52.344095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:52.344248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:52.349372 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=136,cinder:UPDATE=35,cinder:INSERT=4 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:37:52.376074 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:52.376267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:52.482651 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:52.603380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:52.607498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:52.607498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:52.686345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup MD5 for volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:52.686345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:52.692918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:37:52.699990 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:37:52.700504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:37:52.706097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:37:52.706447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:37:52.710308 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:37:52.710803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-157169470, sha256file filename: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:37:52.779224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:37:52.779224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-157169470, metadata filename: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:37:52.802559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9ab75e80-5f50-483e-b40c-590bd1d8c182",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-1313140847",\n "created_at": "2026-07-05 04:37:37+00:00",\n "objects": [\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "081e351d-d5a0-4847-adac-e633088256be",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"081e351d-d5a0-4847-adac-e633088256be\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"dfdef281010046628d54e944d48905b1\\", \\"project_id\\": \\"005ce52fa061412f80fcbd07a9c69c05\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:35.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:35.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-1770952043\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:35.000000\\", \\"updated_at\\": \\"2026-07-05T04:37:35.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:37:52.806121 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] backup 9ab75e80-5f50-483e-b40c-590bd1d8c182 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:37:52.938039 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:37:52.945437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:52.945630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:52.958195 np0000004568 sudo[140365]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 05 04:37:52.958837 np0000004568 sudo[140365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:37:53.058755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:53.059031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:53.254884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:53.270623 np0000004568 sudo[140365]: pam_unix(sudo:session): session closed for user root Jul 05 04:37:53.272251 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.334s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:37:53.273048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5fbddda-d114-40f8-a495-39391e2d0d0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000ddfc8a0b', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:37:53.273048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:37:53.273533 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:37:53.275591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5fbddda-d114-40f8-a495-39391e2d0d0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:37:53.285673 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:53.286228 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:37:53.286228 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:37:53.286228 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:37:53.286228 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:53.309599 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:37:53.309826 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:37:53.309975 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '145')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:37:53.310113 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b', '142')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:37:53.311293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Resulting device map defaultdict(. at 0x77fdedd36480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b'): ({'sdi'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:37:53.311521 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Removing single pathed devices sdi {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:37:53.322058 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Flushing IO for device /dev/sdi {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:37:53.331680 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:37:53.378950 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:37:53.379136 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:37:53.380288 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:37:53.390218 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:37:53.390422 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:37:53.401615 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:53.446833 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b, portal: 192.168.40.100,3260] Jul 05 04:37:53.446833 np0000004568 cinder-backup[101263]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-d5fbddda-d114-40f8-a495-39391e2d0d0b, portal: 192.168.40.100,3260] successful. Jul 05 04:37:53.446833 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:53.462260 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:37:53.462506 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.189s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:37:53.462675 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] <== disconnect_volume: return (190ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:37:53.530368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:53.530642 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:53.659440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:53.659440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:53.866998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:54.129819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:54.130205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:54.226432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:54.226633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:54.399788 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:54.498069 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c97cbe24-885b-4e7d-a982-288ea476fb71 tempest-VolumesSnapshotTestJSON-1235832462 None] Create backup finished. backup: 9ab75e80-5f50-483e-b40c-590bd1d8c182. Jul 05 04:37:54.651267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:54.651455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:54.763315 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:54.763483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:54.922906 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] Delete backup started, backup: 9ab75e80-5f50-483e-b40c-590bd1d8c182. Jul 05 04:37:54.927762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_005ce52fa061412f80fcbd07a9c69c05 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:37:54.928133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:37:54.928306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] delete started, backup: 9ab75e80-5f50-483e-b40c-590bd1d8c182, container: tempest-volumessnapshottestjson-backup-container-157169470, prefix: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:37:54.973151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] generated object list: ['volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00001', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00002', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00003', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00004', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00005', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00006', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00007', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00008', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00009', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00010', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00011', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00012', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00013', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00014', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00015', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00016', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00017', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00018', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00019', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00020', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00021', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_metadata', 'volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:37:54.978587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:55.003454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00001 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.030089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00002 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.065211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00003 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.090086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00004 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.112185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00005 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.138161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00006 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.157682 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00007 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.176903 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00008 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.195437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00009 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.214466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00010 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.231231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:55.231425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:55.233967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00011 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.259651 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00012 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.280995 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00013 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.302646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00014 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.322469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00015 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.343603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00016 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.351191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:55.351333 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:55.381837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00017 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.392395 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:37:55.406195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00018 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.431633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00019 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.453038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00020 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.476272 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182-00021 in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.495755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_metadata in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.524167 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] deleted object: volume_081e351d-d5a0-4847-adac-e633088256be/20260705043740/az_nova_backup_9ab75e80-5f50-483e-b40c-590bd1d8c182_sha256file in container: tempest-volumessnapshottestjson-backup-container-157169470. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:37:55.524167 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] delete 9ab75e80-5f50-483e-b40c-590bd1d8c182 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:37:55.539825 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] Created reservations ['ecddf3a0-fafd-4db0-9a0e-58e7a65483d4', '5e6cb047-e1ed-438d-8aa0-d329ec5f0217'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:37:55.560907 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-304810d3-7114-42f9-9d3f-233ea088d90b tempest-VolumesSnapshotTestJSON-1235832462 None] Delete backup finished, backup 9ab75e80-5f50-483e-b40c-590bd1d8c182 deleted. Jul 05 04:37:55.596139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:55.834331 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:55.834463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:55.938741 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:55.938898 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:56.147928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:56.396349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:56.396446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:56.493282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:56.493480 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:56.672496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:56.925161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:56.925468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:57.041974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:57.042110 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:57.252379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:57.503169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:57.503327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:57.608765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:57.608974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:57.836721 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:58.080322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:58.080487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:58.189491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:58.189620 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:58.374327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:58.624886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:58.624886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:58.748448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:58.748685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:58.964919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:59.214362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:59.214362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:59.320799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:59.320928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:37:59.505318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:37:59.760013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:37:59.760193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:37:59.874453 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:37:59.874644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:00.056169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:00.292283 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:38:00.292497 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:38:00.314480 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:00.314668 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:00.424282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:00.424477 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:00.616995 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:00.875719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:00.875955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:00.985591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:00.985846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:01.214135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:01.462232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:01.462397 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:01.568437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:01.568681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:01.757142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:02.021522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:02.021861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:02.135802 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:02.136000 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:02.344024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:02.605455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:02.605743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:02.714182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:02.714316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:02.892405 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:03.134227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:03.134428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:03.249058 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:03.249219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:03.355015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:03.478325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:03.478528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:03.539367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup MD5 for volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:03.539535 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:03.546420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:03.551215 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:03.551371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:03.554727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:03.555017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:03.557697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:03.557932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:03.619665 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:03.620464 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:03.643367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "01de51e5-e7eb-47cc-afc5-e6f643471f84",\n "backup_name": "tempest-VolumesBackupsTest-Backup-11252197",\n "created_at": "2026-07-05 04:37:48+00:00",\n "objects": [\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:30.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1742743827\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:30.000000\\", \\"updated_at\\": \\"2026-07-05T04:37:48.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:03.648005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] backup 01de51e5-e7eb-47cc-afc5-e6f643471f84 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:03.773858 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:03.791884 np0000004568 sudo[140441]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:38:03.792494 np0000004568 sudo[140441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:04.088248 np0000004568 sudo[140441]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:04.090275 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.316s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:04.090999 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:04.091196 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:04.091725 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:04.092147 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:04.102450 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:04.103081 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:04.103081 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:04.103081 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:04.103081 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '145')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:04.128265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '145')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:04.129034 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Resulting device map defaultdict(. at 0x77fe0bfe04a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:04.129855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:04.142961 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:04.153242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:04.205035 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:04.205282 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:04.211189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:04.221396 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:04.221748 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:04.231772 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:04.274287 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:38:04.274287 np0000004568 cinder-backup[101263]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:38:04.274287 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:04.292881 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:04.293242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.201s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:04.293469 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] <== disconnect_volume: return (201ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:05.320851 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b56043e9-7722-46f1-bd17-14a91bbb777d tempest-VolumesBackupsTest-1237731642 None] Create backup finished. backup: 01de51e5-e7eb-47cc-afc5-e6f643471f84. Jul 05 04:38:05.996197 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Create backup started, backup: 776bb939-b0d6-4c15-9a9a-097756c0971c volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591. Jul 05 04:38:06.003159 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:05Z,data_timestamp=2026-07-05T04:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1550775375',encryption_key_id=None,fail_reason=None,host='np0000004568',id=776bb939-b0d6-4c15-9a9a-097756c0971c,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(d4d78b36-6949-45e8-91fa-f46da20558cf),parent_id='d4d78b36-6949-45e8-91fa-f46da20558cf',project_id='3df437545ab1476e975d9fb89b84e681',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='360f5b8a81a842d7943d78f3a4896a77',volume_id=b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591) Jul 05 04:38:06.033584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:06.033890 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:06.034364 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:06.044696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:06.064050 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:06.077188 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:06.077553 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:06.085263 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:06.086462 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13', 'fe80::f816:3eff:fe78:2bbd'] Jul 05 04:38:06.086662 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:06.086814 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:06.087105 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:06.594381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:06.594946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:06.595123 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:06.595732 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:06.596050 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:06.609937 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:06.610310 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:06.610533 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:06.622332 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:06.622332 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591] added Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:06.632235 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:06.632496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:06.632746 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0221(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:06.632970 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:07.633910 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:07.644537 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:07.654887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.667906 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.668186 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:07.700107 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:38:07.700107 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:38:07.700107 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:07.711003 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:07.724382 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:07.724613 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:07.724873 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:07.725006 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:07.725813 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:07.725928 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:07.740451 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:07.740675 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:08.743512 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.148s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:08.743937 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] <== connect_volume: return (2149ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799097', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:08.744177 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:08.763698 np0000004568 sudo[140597]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:38:08.764320 np0000004568 sudo[140597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:09.062616 np0000004568 sudo[140597]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:09.064767 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.320s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:09.109951 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:09.121363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:38:09.156038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:38:09.163025 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _create_container started, container: volumebackups,backup: 776bb939-b0d6-4c15-9a9a-097756c0971c. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:09.190924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] generate_object_name_prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:09.195661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] starting backup of volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, volume size: 1073741824, object names prefix volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:13.001736 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:13.007681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:13.007887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:13.012146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:13.012338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:13.015958 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:13.016211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:13.080528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:13.081205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:13.110120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "776bb939-b0d6-4c15-9a9a-097756c0971c",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1550775375",\n "created_at": "2026-07-05 04:38:06+00:00",\n "objects": [],\n "parent_id": "d4d78b36-6949-45e8-91fa-f46da20558cf",\n "version": "1.0.0",\n "volume_id": "b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:30.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1742743827\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:30.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:06.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:13.121263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] backup 776bb939-b0d6-4c15-9a9a-097756c0971c finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:13.249181 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:13.272685 np0000004568 sudo[140736]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:38:13.273474 np0000004568 sudo[140736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:13.604785 np0000004568 sudo[140736]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:13.607531 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.358s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:13.608141 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799097', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:13.608312 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:13.608793 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:13.609137 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:13.620785 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:13.621224 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:13.621224 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:13.621224 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:13.621290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:13.642303 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:13.642484 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:13.642659 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '146')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:13.642812 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '146')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:13.643842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Resulting device map defaultdict(. at 0x77fded9baa20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:13.644072 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:13.654940 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:13.663169 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:13.713266 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:13.713441 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:13.714453 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:13.725248 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:13.725464 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:13.736131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:13.777695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:38:13.777695 np0000004568 cinder-backup[101263]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:38:13.777695 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:13.791036 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:13.791397 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:13.791548 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] <== disconnect_volume: return (182ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:14.633297 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Create backup started, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4 volume: e577af87-606d-4116-a3c2-cf12b90b0ab9. Jul 05 04:38:14.642295 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:14Z,data_timestamp=2026-07-05T04:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1908889847',encryption_key_id=None,fail_reason=None,host='np0000004568',id=7f35d128-ec48-4f10-886f-6c547cf61dc4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6cf0e5a3cf9d496e9844de11fe8f2ca2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='25eb2ff26959420ca620822326107d74',volume_id=e577af87-606d-4116-a3c2-cf12b90b0ab9) Jul 05 04:38:14.667972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:14.668194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:14.668481 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:14.678535 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:14.696896 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:14.710278 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:14.710677 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:14.718642 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:14.719779 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:38:14.722250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:14.722250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:14.722250 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:14.833401 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:14.854327 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-79fd6208-6129-43d3-899f-e15331faa5a6 tempest-VolumesBackupsTest-450201696 None] Create backup finished. backup: 776bb939-b0d6-4c15-9a9a-097756c0971c. Jul 05 04:38:15.224015 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:15.224469 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:15.224684 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:15.225154 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:15.225378 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:15.237099 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:15.237547 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:15.237854 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:15.249076 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:15.249076 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9] added Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:15.265291 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:15.265513 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:15.265877 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:15.266069 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:15.335339 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Create backup started, backup: b5c84d36-0f18-42d2-a47f-2ee884d6c7bc volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591. Jul 05 04:38:15.343380 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:15Z,data_timestamp=2026-07-05T04:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-176904370',encryption_key_id=None,fail_reason=None,host='np0000004568',id=b5c84d36-0f18-42d2-a47f-2ee884d6c7bc,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(01de51e5-e7eb-47cc-afc5-e6f643471f84),parent_id='01de51e5-e7eb-47cc-afc5-e6f643471f84',project_id='54d18d9011264c4c8ea512094609bdd8',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='29a9b1baae9240ec94ec3a14d43774f0',volume_id=b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591) Jul 05 04:38:15.366432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:15.366815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:15.367082 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:15.377069 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:15.395665 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:15.408803 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:15.409053 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:15.416598 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:15.417654 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:38:15.418468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:15.418468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:15.418468 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:15.922459 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:15.922933 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:15.923073 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:16.267923 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:16.278733 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:16.288845 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.306753 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:16.343498 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] Jul 05 04:38:16.343498 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] successful. Jul 05 04:38:16.343498 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:16.355802 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:16.368813 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:16.369031 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:16.369419 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:16.369703 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:16.370549 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] HCTL ('9', '-', '-', 0) found on session 147 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:16.370721 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:16.383243 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 147 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:16.383243 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:17.386654 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.161s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:17.387086 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (2161ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799131', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:17.387086 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:17.402374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.478s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:17.402856 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:17.413791 np0000004568 sudo[140848]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:38:17.414359 np0000004568 sudo[140848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:17.417455 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:17.417909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:17.418155 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:17.428739 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:17.428739 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591] added Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:17.438869 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:17.439124 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:17.439771 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0214(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:17.440018 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:17.725315 np0000004568 sudo[140848]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:17.726988 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.340s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:17.770678 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:17.776376 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _create_container started, container: volumebackups,backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:18.046451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] generate_object_name_prefix: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:18.054380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] starting backup of volume: e577af87-606d-4116-a3c2-cf12b90b0ab9, volume size: 1073741824, object names prefix volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:18.232128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:18.440906 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:18.453955 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:18.467015 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:18.484624 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:18.484803 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:18.496881 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:18.497075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:18.519103 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:38:18.519103 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:38:18.519103 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:18.532594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:18.552541 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:18.552848 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:18.553044 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:18.553117 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:18.553860 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] HCTL ('10', '-', '-', 0) found on session 148 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:18.553993 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:18.566867 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Searching for a device in session 148 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:18.567094 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:18.615349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:18.615581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:18.810753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:19.081399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:19.081603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:19.188346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:19.188504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:19.382003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:19.569423 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:19.569870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] <== connect_volume: return (3646ms) {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sde'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:19.570003 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:19.596236 np0000004568 sudo[140899]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 04:38:19.597473 np0000004568 sudo[140899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:19.636889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:19.637113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:19.757038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:19.757231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:19.954009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:19.997739 np0000004568 sudo[140899]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:19.999545 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.429s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:20.004360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:38:20.049638 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:38:20.058199 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _create_container started, container: volumebackups,backup: b5c84d36-0f18-42d2-a47f-2ee884d6c7bc. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:20.093402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] generate_object_name_prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:20.100546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] starting backup of volume: b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, volume size: 1073741824, object names prefix volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:20.219195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:20.219416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:20.350951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:20.351193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:20.626026 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:20.950561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:20.950845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:21.063114 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:21.065644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:21.455427 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:21.717288 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:21.717758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:21.838951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:21.839148 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:22.137098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:22.401414 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:22.401687 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:22.523612 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:22.523748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:22.818412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:23.059133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:23.059338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:23.165739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:23.166203 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:23.384378 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:23.680252 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:23.680495 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:23.804752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:23.804920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:24.113802 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:24.358965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:24.359162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:24.468512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:24.468512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:24.735706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:24.804479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:24.811664 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:24.811801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:24.816948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:24.817075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:24.825732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:24.825972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:24.905832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:24.906728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:24.930488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b5c84d36-0f18-42d2-a47f-2ee884d6c7bc",\n "backup_name": "tempest-VolumesBackupsTest-Backup-176904370",\n "created_at": "2026-07-05 04:38:15+00:00",\n "objects": [],\n "parent_id": "01de51e5-e7eb-47cc-afc5-e6f643471f84",\n "version": "1.0.0",\n "volume_id": "b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"29a9b1baae9240ec94ec3a14d43774f0\\", \\"project_id\\": \\"54d18d9011264c4c8ea512094609bdd8\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:37:30.000000\\", \\"launched_at\\": \\"2026-07-05T04:37:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1742743827\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:37:30.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:15.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:24.939551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] backup b5c84d36-0f18-42d2-a47f-2ee884d6c7bc finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:25.092590 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:25.102914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:25.103239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:25.114395 np0000004568 sudo[141117]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 04:38:25.115094 np0000004568 sudo[141117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:25.229200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:25.229643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:25.423449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:25.444353 np0000004568 sudo[141117]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:25.448314 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.356s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:25.448930 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000a80f8c67', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:25.449171 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:25.449666 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:25.450060 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:25.463868 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:25.464584 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:25.464584 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:25.464584 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:25.464584 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:25.491708 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:25.492029 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '150')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:25.492289 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591', '148')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:25.493162 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Resulting device map defaultdict(. at 0x77fded96e520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591'): ({'sde'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:25.493362 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Removing single pathed devices sde {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:25.503178 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Flushing IO for device /dev/sde {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:25.509864 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:25.554977 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:25.555147 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:25.556451 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:25.567261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:25.567475 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:25.578786 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:25.617459 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] Jul 05 04:38:25.617459 np0000004568 cinder-backup[101263]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591, portal: 192.168.40.100,3260] successful. Jul 05 04:38:25.617459 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:25.632138 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:25.632467 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:25.632614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] <== disconnect_volume: return (183ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:25.683878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:25.684078 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:25.783656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:25.783834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:25.976657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:26.266796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:26.267136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:26.401189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:26.401322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:26.597132 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:26.655206 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4d4b4812-0bb0-4b2d-a026-3f60244c22ac tempest-VolumesBackupsTest-1237731642 None] Create backup finished. backup: b5c84d36-0f18-42d2-a47f-2ee884d6c7bc. Jul 05 04:38:26.836094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:26.836331 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:26.939346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:26.939474 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:27.118440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:27.365798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:27.366251 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:27.467635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:27.467837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:27.657856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:27.671739 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] Delete backup started, backup: b5c84d36-0f18-42d2-a47f-2ee884d6c7bc. Jul 05 04:38:27.683258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:27.685250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:27.685250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] delete started, backup: b5c84d36-0f18-42d2-a47f-2ee884d6c7bc, container: volumebackups, prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:27.723045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] generated object list: ['volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_metadata', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:27.744807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:27.763975 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043820/az_nova_backup_b5c84d36-0f18-42d2-a47f-2ee884d6c7bc_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:27.764188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] delete b5c84d36-0f18-42d2-a47f-2ee884d6c7bc finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:27.801703 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:27.815111 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] Created reservations ['6c948793-96c6-41a7-a057-65d00931e8b6', '1ef001b8-25aa-49f7-8bcb-b3b61e8c7276'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:27.839403 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-734da8d6-7f1e-4c69-a56b-c711635ae175 tempest-VolumesBackupsTest-1237731642 None] Delete backup finished, backup b5c84d36-0f18-42d2-a47f-2ee884d6c7bc deleted. Jul 05 04:38:27.912949 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:27.913119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:28.029177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:28.029177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:28.245160 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:28.505352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:28.505910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:28.620864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:28.621025 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:28.761074 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] Delete backup started, backup: 776bb939-b0d6-4c15-9a9a-097756c0971c. Jul 05 04:38:28.765189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:28.765538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:28.765657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] delete started, backup: 776bb939-b0d6-4c15-9a9a-097756c0971c, container: volumebackups, prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:28.831688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] generated object list: ['volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_metadata', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:28.836210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:28.857113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:28.883306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043809/az_nova_backup_776bb939-b0d6-4c15-9a9a-097756c0971c_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:28.883562 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] delete 776bb939-b0d6-4c15-9a9a-097756c0971c finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:28.937480 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:28.961411 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] Created reservations ['cb56259e-67ad-496a-8cae-d30b785a22e4', 'b0934453-7ba3-4b33-a02b-112828d44b87'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:28.994177 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a43c5f22-8045-4995-ab4a-8f348ffe9133 tempest-VolumesBackupsTest-450201696 None] Delete backup finished, backup 776bb939-b0d6-4c15-9a9a-097756c0971c deleted. Jul 05 04:38:29.107483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:29.107483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:29.216556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:29.216766 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:29.428554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:29.721849 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:29.722326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:29.836014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:29.836014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:29.863660 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] Delete backup started, backup: 01de51e5-e7eb-47cc-afc5-e6f643471f84. Jul 05 04:38:29.869110 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_54d18d9011264c4c8ea512094609bdd8 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:29.869865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:29.870499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] delete started, backup: 01de51e5-e7eb-47cc-afc5-e6f643471f84, container: volumebackups, prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:29.950327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] generated object list: ['volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00001', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00002', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00003', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00004', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00005', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00006', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00007', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00008', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00009', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00010', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00011', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00012', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00013', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00014', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00015', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00016', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00017', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00018', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00019', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00020', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00021', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_metadata', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:29.979407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.015156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.040081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.058367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:30.068137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.099127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.124024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.152563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.179319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.211015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.238239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.260227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.286785 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.315382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.317940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:30.318157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:30.349857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.383499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.409498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.430663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.443037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:30.443238 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:30.489198 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.494743 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:30.510477 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.552207 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.582540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.602219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:30.605585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.634099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043751/az_nova_backup_01de51e5-e7eb-47cc-afc5-e6f643471f84_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:30.634342 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] delete 01de51e5-e7eb-47cc-afc5-e6f643471f84 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:30.650025 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] Created reservations ['9bd3466e-f939-420d-b7b5-20b1ecc09a47', '9808566c-e325-4220-ac95-d746b37c94ee'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:30.677705 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9ffba1a2-19c6-4d4f-a6cf-3ede8f6ab3f1 tempest-VolumesBackupsTest-1237731642 None] Delete backup finished, backup 01de51e5-e7eb-47cc-afc5-e6f643471f84 deleted. Jul 05 04:38:30.733806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:30.734065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:30.800935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:30.801116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:30.808224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:30.813978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:30.814135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:30.817628 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:30.817782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:30.820683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:30.820905 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:30.881792 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:30.882731 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _write_metadata started, container name: volumebackups, metadata filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:30.907496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7f35d128-ec48-4f10-886f-6c547cf61dc4",\n "backup_name": "tempest-type-Backup-1908889847",\n "created_at": "2026-07-05 04:38:15+00:00",\n "objects": [\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e577af87-606d-4116-a3c2-cf12b90b0ab9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e577af87-606d-4116-a3c2-cf12b90b0ab9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"25eb2ff26959420ca620822326107d74\\", \\"project_id\\": \\"6cf0e5a3cf9d496e9844de11fe8f2ca2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:38:14.000000\\", \\"launched_at\\": \\"2026-07-05T04:38:14.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-432062379\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:38:13.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:15.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:30.912484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] backup 7f35d128-ec48-4f10-886f-6c547cf61dc4 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:31.059840 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:31.070179 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] Delete backup started, backup: d4d78b36-6949-45e8-91fa-f46da20558cf. Jul 05 04:38:31.078455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3df437545ab1476e975d9fb89b84e681 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:31.078455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:31.080258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] delete started, backup: d4d78b36-6949-45e8-91fa-f46da20558cf, container: volumebackups, prefix: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:31.084959 np0000004568 sudo[141310]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:38:31.085744 np0000004568 sudo[141310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:31.124275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] generated object list: ['volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00001', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00002', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00003', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00004', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00005', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00006', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00007', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00008', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00009', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00010', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00011', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00012', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00013', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00014', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00015', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00016', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00017', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00018', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00019', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00020', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00021', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_metadata', 'volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:31.149418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.169117 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.197690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.218119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.251466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.276913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.302650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.328719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.354543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.376419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.400688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.426256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.433407 np0000004568 sudo[141310]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:31.435614 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.375s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:31.435614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799131', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:31.435898 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:31.436206 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:31.436623 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:31.449357 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:31.450849 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:31.450849 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:31.450849 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:31.450849 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:31.452145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.473605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:31.476980 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:31.477372 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:31.477909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '150')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:31.479690 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', '147')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:31.479690 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fdedda6160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:31.479690 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:31.490266 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:31.497051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.499996 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:31.520340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.548073 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.558028 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:31.558323 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:31.560149 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:31.570999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.574873 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:31.575189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:31.588984 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:31.597657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.621460 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] Jul 05 04:38:31.621460 np0000004568 cinder-backup[101263]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] successful. Jul 05 04:38:31.621460 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:31.624636 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.637780 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:31.638122 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.202s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:31.638355 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (202ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:31.654344 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.674989 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.699671 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] deleted object: volume_b7c6fc42-bcf3-474b-b6e9-5fa6dd34a591/20260705043734/az_nova_backup_d4d78b36-6949-45e8-91fa-f46da20558cf_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:31.700319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] delete d4d78b36-6949-45e8-91fa-f46da20558cf finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:31.752657 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:31.769755 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] Created reservations ['6db916f0-d577-47d7-80c6-505316a74167', '909715c6-a8c7-48ba-be39-a40b7bf9161d'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:31.789324 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-757d954a-81d3-431e-bda1-7368cc4c01d1 tempest-VolumesBackupsTest-450201696 None] Delete backup finished, backup d4d78b36-6949-45e8-91fa-f46da20558cf deleted. Jul 05 04:38:32.662046 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-588e72f3-cae3-4b4d-ab39-f282f581d02b tempest-ProjectAdminTests33-1174657105 None] Create backup finished. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4. Jul 05 04:38:33.164773 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Create backup started, backup: bb720189-b38f-4f93-bc14-9ff64bf37fc9 volume: e577af87-606d-4116-a3c2-cf12b90b0ab9. Jul 05 04:38:33.181718 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:33Z,data_timestamp=2026-07-05T04:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004568',id=bb720189-b38f-4f93-bc14-9ff64bf37fc9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6cf0e5a3cf9d496e9844de11fe8f2ca2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='25eb2ff26959420ca620822326107d74',volume_id=e577af87-606d-4116-a3c2-cf12b90b0ab9) Jul 05 04:38:33.214030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:33.214336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:33.214827 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:33.228173 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:33.256201 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:33.274435 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:33.275641 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:33.286500 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:33.287534 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13'] Jul 05 04:38:33.287695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:33.287827 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:33.288069 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:33.792906 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:33.793450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:33.793700 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:33.794252 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:33.794538 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:33.806076 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:33.806438 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:33.806666 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:33.817479 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:33.817479 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9] added Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:33.829358 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:33.829562 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:33.830018 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:33.830247 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:34.831182 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:34.843505 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:34.856828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.872465 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.872796 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:34.909900 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] Jul 05 04:38:34.909900 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] successful. Jul 05 04:38:34.909900 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:34.921387 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:34.943970 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:34.944254 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:34.944835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:34.944835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:34.945866 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] HCTL ('9', '-', '-', 0) found on session 151 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:34.945866 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:34.959056 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 151 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:34.960420 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:35.963234 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.169s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:35.963714 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (2169ms) {'type': 'block', 'scsi_wwn': '330000000c2c58afa', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:35.963917 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:35.981815 np0000004568 sudo[141409]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:38:35.982435 np0000004568 sudo[141409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:36.338791 np0000004568 sudo[141409]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:36.340815 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.376s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:36.395045 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:36.404157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _create_container started, container: volumebackups,backup: bb720189-b38f-4f93-bc14-9ff64bf37fc9. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:36.437513 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] generate_object_name_prefix: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:36.446370 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] starting backup of volume: e577af87-606d-4116-a3c2-cf12b90b0ab9, volume size: 1073741824, object names prefix volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:36.633104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:36.914437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:36.914437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:37.034165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:37.034646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:37.233521 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:37.480602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:37.481784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:37.584880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:37.585081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:37.802894 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:38.046812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:38.047162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:38.153035 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:38.153174 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:38.340616 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:38.586310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:38.586512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:38.696911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:38.697158 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:38.826065 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Create backup started, backup: aa16abdf-d751-4166-95ab-3dc6b4844506 volume: 91b6488b-8161-464b-903b-2d23aaeef2c7. Jul 05 04:38:38.831142 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:38Z,data_timestamp=2026-07-05T04:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromBackupTest-Backup-1052055406',encryption_key_id=None,fail_reason=None,host='np0000004568',id=aa16abdf-d751-4166-95ab-3dc6b4844506,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3c790f823cb049d0999842308a1278b9',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='838e1d18cf65421f9199163d3ba20947',volume_id=91b6488b-8161-464b-903b-2d23aaeef2c7) Jul 05 04:38:38.862251 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3c790f823cb049d0999842308a1278b9 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:38.862634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:38.863059 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:38.874518 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:38.892999 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:38.906916 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:38.907109 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:38.917272 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:38.918433 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13'] Jul 05 04:38:38.918955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:38.918955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:38.918955 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:38.922330 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:39.179181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:39.179595 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:39.290081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:39.290291 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:39.327041 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:39.423263 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:39.423712 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91b6488b-8161-464b-903b-2d23aaeef2c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:39.423905 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:39.424372 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:39.424655 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91b6488b-8161-464b-903b-2d23aaeef2c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:39.436322 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:39.436739 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:39.436943 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:39.447326 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:39.447326 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7] added Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:39.458629 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:39.458999 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:39.459383 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:39.460039 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:39.531213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:39.774761 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:39.776127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:39.882319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:39.882613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:40.059816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:40.317322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:40.317322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:40.424749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:40.424922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:40.460657 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:40.474505 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:40.490399 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:40.505336 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:40.505667 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:40.545161 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7, portal: 192.168.40.100,3260] Jul 05 04:38:40.545161 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7, portal: 192.168.40.100,3260] successful. Jul 05 04:38:40.545161 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:40.556542 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:40.574471 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:40.574937 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:40.575268 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:40.575927 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] HCTL ('10', '-', '-', 0) found on session 152 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:40.576055 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:40.596909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Searching for a device in session 152 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:40.596909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91b6488b-8161-464b-903b-2d23aaeef2c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:40.660675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:40.906491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:40.906706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:41.007521 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:41.007720 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:41.226405 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:41.481501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:41.481501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:41.587801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:41.587801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:41.602248 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.176s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:41.602788 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] <== connect_volume: return (2177ms) {'type': 'block', 'scsi_wwn': '33000000060557a1d', 'path': '/dev/sde'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:41.605924 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:41.627997 np0000004568 sudo[141493]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 04:38:41.628682 np0000004568 sudo[141493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:41.780868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:41.946473 np0000004568 sudo[141493]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:41.948278 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.344s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:41.959256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _create_container started, container: volumebackups,backup: aa16abdf-d751-4166-95ab-3dc6b4844506. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:42.032241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:42.032241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:42.045669 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] generate_object_name_prefix: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:42.051198 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] starting backup of volume: 91b6488b-8161-464b-903b-2d23aaeef2c7, volume size: 1073741824, object names prefix volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:42.131473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:42.131662 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:42.287318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:42.367467 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:42.532186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:42.532695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:42.636152 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:42.636361 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:42.655752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:42.655957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:42.768562 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:42.768789 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:42.820592 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:42.974559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:43.077822 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:43.077954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:43.178685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:43.178966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:43.220687 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:43.222130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:43.325525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:43.325525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:43.381217 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:43.509007 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:43.648462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:43.648462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:43.757715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:43.757715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:43.763163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:43.763163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:43.888349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:43.888619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:43.988299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:44.089172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:44.250277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:44.250451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:44.334547 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:44.334712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:44.352423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:44.352628 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:44.449746 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:44.449975 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:44.598244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:44.691069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:44.863192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:44.863387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:44.945704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:44.945822 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:44.971111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:44.971309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:45.050217 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:45.050217 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:45.185313 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:45.276260 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:45.446863 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:45.447175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:45.535649 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:45.535781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:45.550188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:45.550334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:45.636280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:45.636507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:45.811715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:45.884741 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:46.066447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:46.066700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:46.124890 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:46.125153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:46.166435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:46.166671 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:46.240587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:46.240587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:46.406652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:46.476439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:46.670421 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:46.670421 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:46.731294 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:46.731490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:46.779945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:46.780124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:46.836380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:46.836942 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:47.017923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:47.078839 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:47.275080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:47.275225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:47.339919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:47.340115 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:47.381363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:47.381578 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:47.448134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:47.448359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:47.653644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:47.724472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:47.912751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:47.913105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:48.001240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:48.001405 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:48.027983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:48.028300 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:48.126718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:48.126914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:48.292451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:48.311878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:48.417626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:48.417796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:48.479531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:48.479730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:48.486468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:48.492400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:48.492490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:48.496534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:48.496711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:48.499678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:48.499919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:48.562279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:48.562551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:48.564431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:48.565008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _write_metadata started, container name: volumebackups, metadata filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:48.595146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "bb720189-b38f-4f93-bc14-9ff64bf37fc9",\n "backup_name": null,\n "created_at": "2026-07-05 04:38:33+00:00",\n "objects": [\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e577af87-606d-4116-a3c2-cf12b90b0ab9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e577af87-606d-4116-a3c2-cf12b90b0ab9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"25eb2ff26959420ca620822326107d74\\", \\"project_id\\": \\"6cf0e5a3cf9d496e9844de11fe8f2ca2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:38:14.000000\\", \\"launched_at\\": \\"2026-07-05T04:38:14.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-432062379\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:38:13.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:33.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:48.601214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] backup bb720189-b38f-4f93-bc14-9ff64bf37fc9 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:48.738877 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:48.747844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:48.748123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:48.770628 np0000004568 sudo[141817]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:38:48.773899 np0000004568 sudo[141817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:48.972242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:49.132306 np0000004568 sudo[141817]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:49.134155 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.396s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:49.134813 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c2c58afa', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:49.135102 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:49.221746 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:49.221837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:49.286916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.152s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:49.287358 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e577af87-606d-4116-a3c2-cf12b90b0ab9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:49.301056 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:49.301601 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:49.301601 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:49.301601 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:49.301601 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:49.320419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:49.320551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:49.326364 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:49.326609 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:49.326796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', '152')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:49.326875 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9', '151')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:49.327804 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fe0bfe37e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:49.328043 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:49.340922 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:49.348305 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:49.408941 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:49.409142 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:49.410372 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:49.422960 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:49.423254 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:49.434450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:49.476853 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] Jul 05 04:38:49.476853 np0000004568 cinder-backup[101263]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-e577af87-606d-4116-a3c2-cf12b90b0ab9, portal: 192.168.40.100,3260] successful. Jul 05 04:38:49.476853 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:49.495264 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:49.495535 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.209s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:49.495735 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (361ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:49.526155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:49.760264 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:49.760417 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:49.860450 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:49.860708 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:50.035254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:50.284714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:50.284920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:50.383638 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:50.383901 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:50.513688 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c44c1666-4293-4c9e-b3b0-94d857ece52c tempest-ProjectAdminTests33-1174657105 None] Create backup finished. backup: bb720189-b38f-4f93-bc14-9ff64bf37fc9. Jul 05 04:38:50.554247 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: bb720189-b38f-4f93-bc14-9ff64bf37fc9. Jul 05 04:38:50.560845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:50.561130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:50.561245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] delete started, backup: bb720189-b38f-4f93-bc14-9ff64bf37fc9, container: volumebackups, prefix: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:50.594557 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:50.603456 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00001', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00002', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00003', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00004', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00005', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00006', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00007', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00008', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00009', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00010', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00011', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00012', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00013', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00014', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00015', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00016', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00017', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00018', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00019', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00020', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00021', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_metadata', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:50.627275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.649335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.674296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.695263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.718151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.742769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.764179 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.788855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.813688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.836108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.859643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.863263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:50.864342 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:50.882787 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.904400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.936359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.960359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:50.972993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:50.973272 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:51.002752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.013644 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:51.026045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.043893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.063981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.089335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.109303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.129222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.146137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043836/az_nova_backup_bb720189-b38f-4f93-bc14-9ff64bf37fc9_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:51.146349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] delete bb720189-b38f-4f93-bc14-9ff64bf37fc9 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:51.160603 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] Created reservations ['04d37c71-554e-44d3-a893-1f7be4d9efad', '06d9c8cc-940a-43e6-8a53-edb0ed11cd12'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:51.189153 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-46f6016e-c4bd-4f5f-9c19-5df048f1ab45 tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup bb720189-b38f-4f93-bc14-9ff64bf37fc9 deleted. Jul 05 04:38:51.215406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:51.458675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:51.458675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:51.553776 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:51.553959 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:51.722896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:51.884414 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Create backup started, backup: 886ac9a6-f7f7-47a9-a914-e7cbf16ef792 volume: a040e14a-613b-4e96-9fba-49bc49400238. Jul 05 04:38:51.888723 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:38:51Z,data_timestamp=2026-07-05T04:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1517825021',encryption_key_id=None,fail_reason=None,host='np0000004568',id=886ac9a6-f7f7-47a9-a914-e7cbf16ef792,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6cf0e5a3cf9d496e9844de11fe8f2ca2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='25eb2ff26959420ca620822326107d74',volume_id=a040e14a-613b-4e96-9fba-49bc49400238) Jul 05 04:38:51.911927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:51.912297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:51.912741 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:51.927553 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:38:51.949585 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:51.964485 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:38:51.964866 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:38:51.973515 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:38:51.974750 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999', 'fe80::f816:3eff:fed1:2206', 'fe80::6408:51ff:fe6c:9f13', 'fe80::f816:3eff:fef4:c7e1', 'fe80::2049:ff:fe12:17a3'] Jul 05 04:38:51.974946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:38:51.975151 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:38:51.975401 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:51.984043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:51.984206 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:52.086320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:52.086773 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:52.127768 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:52.333291 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:52.479579 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:38:52.480092 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a040e14a-613b-4e96-9fba-49bc49400238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:52.480307 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:52.573428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:52.573673 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:52.684432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:52.684675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:52.686377 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=231,cinder:UPDATE=75,cinder:INSERT=12 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:38:52.693499 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.213s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:52.693499 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a040e14a-613b-4e96-9fba-49bc49400238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:38:52.705467 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:52.705604 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:52.705850 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:52.715810 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:38:52.715810 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238] added Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:38:52.724668 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:52.724857 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:38:52.725290 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0194(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:38:52.725516 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:38:52.858038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:53.098886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:53.099261 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:53.202626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:53.202760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:53.375806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:53.625156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:53.625320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:53.729139 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:38:53.732912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:53.732912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:38:53.742967 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:53.756929 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.775173 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:53.829537 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238, portal: 192.168.40.100,3260] Jul 05 04:38:53.829537 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238, portal: 192.168.40.100,3260] successful. Jul 05 04:38:53.829537 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:53.840017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:53.841534 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:38:53.861966 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:38:53.862318 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:53.862702 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:53.862702 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:38:53.863761 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] HCTL ('14', '-', '-', 0) found on session 157 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:38:53.863936 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:38:53.885247 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 157 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:38:53.885247 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a040e14a-613b-4e96-9fba-49bc49400238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:38:53.979581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:53.979786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:54.050522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup MD5 for volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:54.050522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:54.059052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:38:54.065273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:38:54.065525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:38:54.069283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:38:54.069504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:38:54.072496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:38:54.072840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:38:54.126273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:38:54.126994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _write_metadata started, container name: volumebackups, metadata filename: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:38:54.149488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "aa16abdf-d751-4166-95ab-3dc6b4844506",\n "backup_name": "tempest-CreateVolumesFromBackupTest-Backup-1052055406",\n "created_at": "2026-07-05 04:38:39+00:00",\n "objects": [\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "91b6488b-8161-464b-903b-2d23aaeef2c7",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"91b6488b-8161-464b-903b-2d23aaeef2c7\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"838e1d18cf65421f9199163d3ba20947\\", \\"project_id\\": \\"3c790f823cb049d0999842308a1278b9\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:38:38.000000\\", \\"launched_at\\": \\"2026-07-05T04:38:38.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-CreateVolumesFromBackupTest-Volume-250693661\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:38:38.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:39.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:38:54.154813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] backup aa16abdf-d751-4166-95ab-3dc6b4844506 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:38:54.283324 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:54.302456 np0000004568 sudo[142245]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 04:38:54.303162 np0000004568 sudo[142245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:54.590170 np0000004568 sudo[142245]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:54.592196 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.309s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:54.592904 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91b6488b-8161-464b-903b-2d23aaeef2c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000060557a1d', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:38:54.593090 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:38:54.890959 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.198s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:54.891266 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (2410ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799145', 'path': '/dev/sdi'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:54.891770 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:38:54.900154 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.306s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:38:54.901193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91b6488b-8161-464b-903b-2d23aaeef2c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:38:54.912063 np0000004568 sudo[142248]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 05 04:38:54.912870 np0000004568 sudo[142248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:38:54.914923 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:54.915484 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:38:54.915484 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:38:54.915484 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:38:54.915484 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:38:54.940282 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:38:54.940588 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:38:54.940909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', '157')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:38:54.940909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7', '152')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:38:54.941882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Resulting device map defaultdict(. at 0x77fded6f4ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7'): ({'sde'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:38:54.942076 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Removing single pathed devices sde {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:38:54.955244 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Flushing IO for device /dev/sde {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:38:54.964311 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:38:54.996851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:38:54.997039 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:38:54.998581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:38:55.009476 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:38:55.009753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:38:55.022139 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:55.063561 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7, portal: 192.168.40.100,3260] Jul 05 04:38:55.063561 np0000004568 cinder-backup[101263]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-91b6488b-8161-464b-903b-2d23aaeef2c7, portal: 192.168.40.100,3260] successful. Jul 05 04:38:55.063561 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:55.082550 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:38:55.082904 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.184s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:38:55.083115 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] <== disconnect_volume: return (490ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:38:55.238603 np0000004568 sudo[142248]: pam_unix(sudo:session): session closed for user root Jul 05 04:38:55.241872 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.349s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:38:55.247335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _create_container started, container: volumebackups,backup: 886ac9a6-f7f7-47a9-a914-e7cbf16ef792. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:38:55.274846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] generate_object_name_prefix: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:38:55.278817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] starting backup of volume: a040e14a-613b-4e96-9fba-49bc49400238, volume size: 1073741824, object names prefix volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:38:55.451843 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:55.711358 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:55.711358 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:55.832639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:55.832792 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:56.035811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:56.103993 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-dff7183a-c95e-45b5-9251-c03cbfd64eb8 tempest-CreateVolumesFromBackupTest-733494074 None] Create backup finished. backup: aa16abdf-d751-4166-95ab-3dc6b4844506. Jul 05 04:38:56.293187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:56.293660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:56.422123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:56.422362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:56.673854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:56.919675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:56.919784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:57.036901 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:57.037060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:57.284437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:57.435535 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] Delete backup started, backup: aa16abdf-d751-4166-95ab-3dc6b4844506. Jul 05 04:38:57.443770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_3c790f823cb049d0999842308a1278b9 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:38:57.444079 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:38:57.444172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] delete started, backup: aa16abdf-d751-4166-95ab-3dc6b4844506, container: volumebackups, prefix: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:38:57.504043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] generated object list: ['volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00001', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00002', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00003', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00004', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00005', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00006', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00007', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00008', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00009', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00010', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00011', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00012', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00013', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00014', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00015', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00016', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00017', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00018', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00019', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00020', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00021', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_metadata', 'volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:38:57.525086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.544509 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.549657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:57.549835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:57.564868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.591296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.620032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.645124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.666188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:57.666446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:57.667658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.708518 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:38:57.720334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.742216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.767554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.789984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.813777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.834484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.876807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.900715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.921043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.923719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:57.946178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.964428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.982502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:57.999530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:58.025105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:58.044022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:58.063095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] deleted object: volume_91b6488b-8161-464b-903b-2d23aaeef2c7/20260705043842/az_nova_backup_aa16abdf-d751-4166-95ab-3dc6b4844506_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:38:58.063314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] delete aa16abdf-d751-4166-95ab-3dc6b4844506 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:38:58.078880 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] Created reservations ['95c90e58-6364-4b9b-a37f-9c0b0a66427b', '08da57f6-7757-4e60-939c-4a04652225d2'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:38:58.094275 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-ba79e53a-c482-48b5-bbf3-957b80147d8d tempest-CreateVolumesFromBackupTest-733494074 None] Delete backup finished, backup aa16abdf-d751-4166-95ab-3dc6b4844506 deleted. Jul 05 04:38:58.172458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:58.172997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:58.290013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:58.290250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:58.479238 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:58.732363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:58.732632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:58.841504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:58.841745 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:59.032714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:59.279019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:59.279141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:59.380327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:59.380591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:38:59.568356 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:38:59.819100 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:38:59.819259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:38:59.940819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:38:59.941205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:00.131293 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:00.298593 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:39:00.298790 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:39:00.393027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:00.393027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:00.498407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:00.498651 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:00.692010 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:00.952615 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:00.952790 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:01.054037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:01.055021 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:01.267941 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:01.508136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:01.508381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:01.604237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:01.604386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:01.786622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:02.025235 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:02.025439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:02.124648 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:02.124831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:02.327380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:02.571040 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:02.571199 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:02.679625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:02.679826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:02.867172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:03.116202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:03.116427 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:03.221234 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:03.221393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:03.427761 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:03.689381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:03.689581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:03.787060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:03.787211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:03.960777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:04.206639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:04.206810 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:04.302864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:04.303011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:04.476019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:04.721129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:04.721302 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:04.821348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:04.821581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:05.007197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:05.267688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:05.267888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:05.368473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:05.368722 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:05.555072 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:05.804916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:05.804916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:05.920181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:05.920365 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:06.125403 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:06.365675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:06.365880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:06.471753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:06.471973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:06.573483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:06.703452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:06.703902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:06.771947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:06.772175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:06.780813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:39:06.787997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:39:06.787997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:39:06.792442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:39:06.792666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:39:06.796811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:39:06.796879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:39:06.860862 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:39:06.861257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:39:06.887056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "886ac9a6-f7f7-47a9-a914-e7cbf16ef792",\n "backup_name": "tempest-type-Backup-1517825021",\n "created_at": "2026-07-05 04:38:52+00:00",\n "objects": [\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a040e14a-613b-4e96-9fba-49bc49400238",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a040e14a-613b-4e96-9fba-49bc49400238\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"25eb2ff26959420ca620822326107d74\\", \\"project_id\\": \\"6cf0e5a3cf9d496e9844de11fe8f2ca2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:38:51.000000\\", \\"launched_at\\": \\"2026-07-05T04:38:51.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-224052350\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:38:51.000000\\", \\"updated_at\\": \\"2026-07-05T04:38:52.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:39:06.893920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] backup 886ac9a6-f7f7-47a9-a914-e7cbf16ef792 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:39:07.049006 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:07.072166 np0000004568 sudo[142834]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 05 04:39:07.072933 np0000004568 sudo[142834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:07.405126 np0000004568 sudo[142834]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:07.408883 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.359s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:07.409585 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a040e14a-613b-4e96-9fba-49bc49400238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799145', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:07.409846 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:07.410463 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:07.411181 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a040e14a-613b-4e96-9fba-49bc49400238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:07.426773 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:07.427946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:39:07.427946 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:39:07.427946 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:39:07.427946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:07.458671 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:07.459049 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:07.459338 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af929a0-101a-47e6-ab05-fe2cefe5b904', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5e6085f-bd3c-47ba-90e7-1e59a83b5919', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:39:07.459338 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238', '157')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:39:07.461124 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fded7ed260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238'): ({'sdi'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:39:07.461496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sdi {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:39:07.473506 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sdi {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:39:07.483591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:39:07.537143 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:39:07.537993 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sdi have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:39:07.540949 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:39:07.551563 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:39:07.551933 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:39:07.563310 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:07.600543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238, portal: 192.168.40.100,3260] Jul 05 04:39:07.600543 np0000004568 cinder-backup[101263]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-a040e14a-613b-4e96-9fba-49bc49400238, portal: 192.168.40.100,3260] successful. Jul 05 04:39:07.600543 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:07.620156 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:07.620442 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.210s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:07.620632 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (210ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:08.643501 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-df6c66b9-5740-4548-9086-a3c1415b7c25 tempest-ProjectAdminTests33-1174657105 None] Create backup finished. backup: 886ac9a6-f7f7-47a9-a914-e7cbf16ef792. Jul 05 04:39:09.304367 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: 886ac9a6-f7f7-47a9-a914-e7cbf16ef792. Jul 05 04:39:09.315763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:09.315763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:09.315763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] delete started, backup: 886ac9a6-f7f7-47a9-a914-e7cbf16ef792, container: volumebackups, prefix: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:39:09.374806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00001', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00002', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00003', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00004', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00005', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00006', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00007', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00008', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00009', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00010', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00011', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00012', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00013', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00014', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00015', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00016', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00017', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00018', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00019', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00020', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00021', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_metadata', 'volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:39:09.396483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.442176 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.461369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.482469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.502502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.527223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.554504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.585469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.609068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.643778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.669972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.695640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.716603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.754825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.785863 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.815365 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.840042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.865801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.895263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.927672 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.950924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.968517 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.990637 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_a040e14a-613b-4e96-9fba-49bc49400238/20260705043855/az_nova_backup_886ac9a6-f7f7-47a9-a914-e7cbf16ef792_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:09.990884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] delete 886ac9a6-f7f7-47a9-a914-e7cbf16ef792 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:39:10.025811 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:10.040338 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] Created reservations ['f46057b7-1b5b-40a7-ade2-c768cd247408', '31fc679a-60b2-4efa-93f9-9dd2e21a5328'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:39:10.059241 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-92f0a314-4b20-4827-b60b-f5dd3ae0381b tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup 886ac9a6-f7f7-47a9-a914-e7cbf16ef792 deleted. Jul 05 04:39:10.456905 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-73b64cf7-7d98-4704-b265-d67f55ee82d5 tempest-ProjectAdminTests33-1174657105 None] Export record started, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4. Jul 05 04:39:10.460634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-73b64cf7-7d98-4704-b265-d67f55ee82d5 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:10.460634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-73b64cf7-7d98-4704-b265-d67f55ee82d5 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:10.460842 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-73b64cf7-7d98-4704-b265-d67f55ee82d5 tempest-ProjectAdminTests33-1174657105 None] Export record finished, backup 7f35d128-ec48-4f10-886f-6c547cf61dc4 exported. Jul 05 04:39:12.334445 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:12.344294 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Create backup started, backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0 volume: d5f97f7d-6713-4139-910b-8c11cf624c05. Jul 05 04:39:12.349277 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:39:12Z,data_timestamp=2026-07-05T04:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1939757629',encryption_key_id=None,fail_reason=None,host='np0000004568',id=b4d07921-a7f9-4114-b755-c4fd268ad3d0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6cf0e5a3cf9d496e9844de11fe8f2ca2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='25eb2ff26959420ca620822326107d74',volume_id=d5f97f7d-6713-4139-910b-8c11cf624c05) Jul 05 04:39:12.372878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:12.373464 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:12.373868 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:12.386183 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:12.404478 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:12.418348 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:12.418753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:12.426869 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:12.428360 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe1b:632a', 'fe80::a433:41ff:fe01:9999', 'fe80::f816:3eff:fe2a:301b', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::2049:ff:fe12:17a3'] Jul 05 04:39:12.428543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:12.428699 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:12.429085 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:12.933763 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:12.934199 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5f97f7d-6713-4139-910b-8c11cf624c05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:12.934390 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:12.934957 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:12.935226 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5f97f7d-6713-4139-910b-8c11cf624c05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:39:12.947308 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:12.947732 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:12.947984 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:12.958641 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:39:12.958641 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05] added Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:12.968900 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:12.969123 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:39:12.969637 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:39:12.969900 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:39:13.970826 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:39:13.982432 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:13.993181 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.011133 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.011375 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:14.057889 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05, portal: 192.168.40.100,3260] Jul 05 04:39:14.057889 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05, portal: 192.168.40.100,3260] successful. Jul 05 04:39:14.057889 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:14.073797 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:14.093590 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:14.093923 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:14.094152 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:14.094495 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:39:14.095796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] HCTL ('10', '-', '-', 0) found on session 162 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:39:14.095950 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:39:14.114456 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 162 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:39:14.114456 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5f97f7d-6713-4139-910b-8c11cf624c05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:39:15.117627 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.182s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:15.118110 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (2183ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799159', 'path': '/dev/sde'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:15.118110 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:15.136724 np0000004568 sudo[143184]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 04:39:15.137372 np0000004568 sudo[143184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:15.429634 np0000004568 sudo[143184]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:15.431728 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.313s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:15.466923 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:15.473016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _create_container started, container: volumebackups,backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:39:15.498835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] generate_object_name_prefix: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:39:15.502872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] starting backup of volume: d5f97f7d-6713-4139-910b-8c11cf624c05, volume size: 1073741824, object names prefix volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:39:15.709268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:15.862804 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Create backup started, backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628 volume: 2eaadcae-a194-4958-a064-2dd7277af6b1. Jul 05 04:39:15.868203 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:39:15Z,data_timestamp=2026-07-05T04:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1697003308',encryption_key_id=None,fail_reason=None,host='np0000004568',id=ee5d63a5-0ba0-47ef-9f6c-648fd8728628,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9f3c8a595ac432b8b3cad8d2dc58ebd',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f84855f2e86c4503b4af670e811002ce',volume_id=2eaadcae-a194-4958-a064-2dd7277af6b1) Jul 05 04:39:15.897108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:15.897280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:15.897892 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:15.911732 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:15.932524 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:15.948518 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:15.948893 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:15.956580 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:15.957835 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe2a:301b', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::f816:3eff:fe26:fb95', 'fe80::2049:ff:fe12:17a3'] Jul 05 04:39:15.958015 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:15.958193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:15.958529 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:15.968146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:15.968321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:16.077001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:16.077173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:16.113498 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:16.298345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:16.462670 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:16.463029 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:16.463178 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:16.463604 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:16.463801 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:39:16.473880 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:16.474255 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:16.474474 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:16.484191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:39:16.484191 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1] added Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:16.494371 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:16.494714 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:39:16.495079 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0205(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:39:16.495272 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:39:16.543519 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:16.543714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:16.639981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:16.640133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:16.816734 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:17.066959 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:17.067098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:17.167399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:17.167560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:17.371985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:17.496292 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:39:17.508006 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:17.521019 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:17.537075 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:17.537488 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:17.581945 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] Jul 05 04:39:17.581945 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] successful. Jul 05 04:39:17.581945 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:17.595686 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] HCTL ('11', '-', '-', 0) found on session 163 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:39:17.614223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:39:17.636910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:17.636910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:17.637995 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 163 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:39:17.638504 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:39:17.757138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:17.757336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:17.976900 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:18.226901 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:18.227083 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:18.327642 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:18.327875 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:18.548272 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:18.643076 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:18.643598 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (2179ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sdf'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:18.643993 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:18.671265 np0000004568 sudo[143258]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 05 04:39:18.672068 np0000004568 sudo[143258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:18.811426 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:18.811647 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:18.915139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:18.915444 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:19.010999 np0000004568 sudo[143258]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:19.015201 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.371s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:19.034702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _create_container started, container: volumebackups,backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:39:19.105781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:19.227458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] generate_object_name_prefix: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:39:19.233945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] starting backup of volume: 2eaadcae-a194-4958-a064-2dd7277af6b1, volume size: 1073741824, object names prefix volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:39:19.381143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:19.381375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:19.422586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:19.489065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:19.489229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:19.703610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:19.726626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:19.726700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:19.855731 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:19.855956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:19.975406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:19.975406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:20.056942 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:20.095960 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:20.096161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:20.301267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:20.413511 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:20.413698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:20.538442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:20.538731 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:20.544263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:20.544487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:20.670729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:20.670729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:20.801597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:20.917041 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:21.072029 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:21.072189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:21.173880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:21.174120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:21.177439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:21.177611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:21.281944 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:21.282157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:21.378957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:21.500895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:21.626409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:21.626609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:21.735056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:21.735166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:21.743967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:21.744182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:21.851981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:21.852425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:21.930502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:22.045090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:22.195367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:22.195544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:22.294281 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:22.294487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:22.296139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:22.297514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:22.402604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:22.402604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:22.622718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:22.630362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:22.871214 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:22.871605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:22.884223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:22.884491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:22.989669 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:22.989884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:23.021096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:23.021270 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:23.263555 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:23.292387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:23.519875 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:23.520069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:23.563872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:23.564076 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:23.623700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:23.623881 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:23.678053 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:23.678329 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:23.887230 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:23.918172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:24.134070 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:24.134249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:24.170142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:24.170371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:24.234166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:24.234360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:24.350659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:24.350848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:24.432929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:24.559256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:24.685486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:24.685609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:24.793886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:24.794064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:24.812004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:24.813286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:24.919263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:24.920705 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:24.991733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:25.117630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:25.239580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:25.239864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:25.351462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:25.351693 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:25.373866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:25.374617 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:25.479171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:25.479171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:25.585290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:25.701732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:25.844977 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:25.845144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:25.957774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:25.958127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:25.964533 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:25.964764 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:26.078131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:26.078371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:26.167661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:26.372755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:26.430925 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:26.431255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:26.535258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:26.535580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:26.637115 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:26.637560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:26.748257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:26.748546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:26.767695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:27.003837 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:27.021780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:27.021780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:27.146611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:27.146611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:27.245188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:27.321636 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:27.321636 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:27.379767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:27.379767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:27.428311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:27.428311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:27.448239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:27.448799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:27.461841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:39:27.473929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:39:27.475097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:39:27.481661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:39:27.481661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:39:27.484545 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:39:27.487588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:39:27.559212 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:39:27.561986 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:39:27.589043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b4d07921-a7f9-4114-b755-c4fd268ad3d0",\n "backup_name": "tempest-type-Backup-1939757629",\n "created_at": "2026-07-05 04:39:12+00:00",\n "objects": [\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d5f97f7d-6713-4139-910b-8c11cf624c05",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d5f97f7d-6713-4139-910b-8c11cf624c05\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"25eb2ff26959420ca620822326107d74\\", \\"project_id\\": \\"6cf0e5a3cf9d496e9844de11fe8f2ca2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:39:11.000000\\", \\"launched_at\\": \\"2026-07-05T04:39:11.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-63259547\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:39:11.000000\\", \\"updated_at\\": \\"2026-07-05T04:39:12.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:39:27.594422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] backup b4d07921-a7f9-4114-b755-c4fd268ad3d0 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:39:27.721681 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:27.730715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:27.742038 np0000004568 sudo[143374]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 04:39:27.742708 np0000004568 sudo[143374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:27.976754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:27.976968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:28.092589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:28.093047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:28.126233 np0000004568 sudo[143374]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:28.127949 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.407s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:28.128494 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5f97f7d-6713-4139-910b-8c11cf624c05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799159', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:28.128726 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:28.311623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:28.566666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:28.566892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:28.688914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:28.689147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:28.877123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:29.135137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:29.135137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:29.241155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:29.241155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:29.434454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:29.697530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:29.697530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:29.800461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:29.800461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:29.893267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.764s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:29.893267 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5f97f7d-6713-4139-910b-8c11cf624c05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:39:29.909581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '165')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:39:29.946337 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05', '162')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:39:29.950590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fded96f920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05'): ({'sde'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:39:29.950590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sde {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:39:29.962426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sde {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:39:29.971096 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:39:29.995682 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:30.034985 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:39:30.034985 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:39:30.034985 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:39:30.045467 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:39:30.045467 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:39:30.056483 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:30.096908 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05, portal: 192.168.40.100,3260] Jul 05 04:39:30.096908 np0000004568 cinder-backup[101263]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-d5f97f7d-6713-4139-910b-8c11cf624c05, portal: 192.168.40.100,3260] successful. Jul 05 04:39:30.096908 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:30.118235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:30.118235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.225s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:30.118235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (1988ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:30.366717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:30.367172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:30.481481 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:30.481716 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:30.689644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:30.929737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:30.929858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:31.032220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:31.032445 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:31.144200 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-da15b97d-c48f-4c5a-8da7-66653a64e1dd tempest-ProjectAdminTests33-1174657105 None] Create backup finished. backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0. Jul 05 04:39:31.237441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:31.480958 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:31.481480 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:31.608825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:31.608825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:31.758125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:31.795389 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1c16afb3-8391-4ead-a618-b34755434b28 tempest-ProjectAdminTests33-1174657105 None] Export record started, backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0. Jul 05 04:39:31.802621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1c16afb3-8391-4ead-a618-b34755434b28 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:31.802621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1c16afb3-8391-4ead-a618-b34755434b28 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:31.802621 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1c16afb3-8391-4ead-a618-b34755434b28 tempest-ProjectAdminTests33-1174657105 None] Export record finished, backup b4d07921-a7f9-4114-b755-c4fd268ad3d0 exported. Jul 05 04:39:31.890660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:31.890660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:31.974596 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:31.974596 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:32.022513 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:32.029442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:39:32.036648 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:39:32.036956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:39:32.041179 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:39:32.041503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:39:32.045226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:39:32.045675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:39:32.115221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:39:32.116634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:39:32.147327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ee5d63a5-0ba0-47ef-9f6c-648fd8728628",\n "backup_name": "tempest-type-Backup-1697003308",\n "created_at": "2026-07-05 04:39:16+00:00",\n "objects": [\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2eaadcae-a194-4958-a064-2dd7277af6b1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2eaadcae-a194-4958-a064-2dd7277af6b1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f84855f2e86c4503b4af670e811002ce\\", \\"project_id\\": \\"c9f3c8a595ac432b8b3cad8d2dc58ebd\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:39:15.000000\\", \\"launched_at\\": \\"2026-07-05T04:39:15.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-110896500\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:39:15.000000\\", \\"updated_at\\": \\"2026-07-05T04:39:16.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:39:32.157678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] backup ee5d63a5-0ba0-47ef-9f6c-648fd8728628 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:39:32.326968 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:32.353465 np0000004568 sudo[143544]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 05 04:39:32.355009 np0000004568 sudo[143544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:32.426136 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-10cc10f9-a439-43ce-a44a-2cbfeef2cc11 tempest-ProjectAdminTests33-1174657105 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiMmY4MDE0ZDMtOTQ0MC00YmI4LWIwYTAtOTI5YWM0YWRhNjcwIiwgInVzZXJfaWQiOiAiMjVlYjJmZjI2OTU5NDIwY2E2MjA4MjIzMjYxMDdkNzQiLCAicHJvamVjdF9pZCI6ICI2Y2YwZTVhM2NmOWQ0OTZlOTg0NGRlMTFmZThmMmNhMiIsICJ2b2x1bWVfaWQiOiAiZDVmOTdmN2QtNjcxMy00MTM5LTkxMGItOGMxMWNmNjI0YzA1IiwgImhvc3QiOiAibnAwMDAwMDA0NTY4IiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInZvbHVtZWJhY2t1cHMiLCAicGFyZW50X2lkIjogbnVsbCwgInN0YXR1cyI6ICJhdmFpbGFibGUiLCAiZmFpbF9yZWFzb24iOiBudWxsLCAic2l6ZSI6IDEsICJkaXNwbGF5X25hbWUiOiAidGVtcGVzdC10eXBlLUJhY2t1cC0xOTM5NzU3NjI5IiwgImRpc3BsYXlfZGVzY3JpcHRpb24iOiBudWxsLCAic2VydmljZV9tZXRhZGF0YSI6ICJ2b2x1bWVfZDVmOTdmN2QtNjcxMy00MTM5LTkxMGItOGMxMWNmNjI0YzA1LzIwMjYwNzA1MDQzOTE1L2F6X25vdmFfYmFja3VwX2I0ZDA3OTIxLWE3ZjktNDExNC1iNzU1LWM0ZmQyNjhhZDNkMCIsICJzZXJ2aWNlIjogImNpbmRlci5iYWNrdXAuZHJpdmVycy5zd2lmdC5Td2lmdEJhY2t1cERyaXZlciIsICJvYmplY3RfY291bnQiOiAyMSwgInRlbXBfdm9sdW1lX2lkIjogbnVsbCwgInRlbXBfc25hcHNob3RfaWQiOiBudWxsLCAibnVtX2RlcGVuZGVudF9iYWNrdXBzIjogMCwgInNuYXBzaG90X2lkIjogbnVsbCwgImRhdGFfdGltZXN0YW1wIjogIjIwMjYtMDctMDVUMDQ6Mzk6MTJaIiwgInJlc3RvcmVfdm9sdW1lX2lkIjogbnVsbCwgIm1ldGFkYXRhIjoge30sICJlbmNyeXB0aW9uX2tleV9pZCI6IG51bGwsICJjcmVhdGVkX2F0IjogIjIwMjYtMDctMDVUMDQ6Mzk6MTJaIiwgInVwZGF0ZWRfYXQiOiAiMjAyNi0wNy0wNVQwNDozOTozMVoiLCAiZGVsZXRlZF9hdCI6IG51bGwsICJkZWxldGVkIjogZmFsc2V9. Jul 05 04:39:32.434770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-10cc10f9-a439-43ce-a44a-2cbfeef2cc11 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:32.435367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-10cc10f9-a439-43ce-a44a-2cbfeef2cc11 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:32.487063 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-10cc10f9-a439-43ce-a44a-2cbfeef2cc11 tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:32.513499 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-10cc10f9-a439-43ce-a44a-2cbfeef2cc11 tempest-ProjectAdminTests33-1174657105 None] Import record id 2f8014d3-9440-4bb8-b0a0-929ac4ada670 metadata from driver finished. Jul 05 04:39:32.741776 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.415s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:32.742798 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:32.742798 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:32.743187 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:32.745858 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:39:32.738731 np0000004568 sudo[143544]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:32.762207 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:32.762948 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:39:32.762948 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:39:32.762948 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:39:32.762948 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:32.793872 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:32.794332 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:32.794653 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '165')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:39:32.794653 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', '163')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:39:32.796212 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fded96c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1'): ({'sdf'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:39:32.796505 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sdf {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:39:32.811261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sdf {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:39:32.823557 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:39:32.885176 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:39:32.885399 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:39:32.887010 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:39:32.901426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:39:32.902178 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:39:32.914548 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:32.954011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] Jul 05 04:39:32.954011 np0000004568 cinder-backup[101263]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] successful. Jul 05 04:39:32.954011 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:32.981899 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:32.982255 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:32.982439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (239ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:33.509141 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: 2f8014d3-9440-4bb8-b0a0-929ac4ada670. Jul 05 04:39:33.514403 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:33.515469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:33.515918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] delete started, backup: 2f8014d3-9440-4bb8-b0a0-929ac4ada670, container: volumebackups, prefix: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:39:33.590373 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00001', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00002', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00003', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00004', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00005', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00006', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00007', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00008', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00009', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00010', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00011', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00012', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00013', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00014', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00015', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00016', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00017', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00018', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00019', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00020', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00021', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_metadata', 'volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:39:33.623600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.651403 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.677320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.706563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.737025 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.763853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.787841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.823730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.847735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.872627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.899979 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.929593 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.960329 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:33.983814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.023543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.033347 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:34.051908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.055866 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e991432-a4c2-4127-ae46-85a363c1b5da tempest-ProjectMemberTests33-954956515 None] Create backup finished. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628. Jul 05 04:39:34.082458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.120094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.146893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.172288 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.197421 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.222355 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.248540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:34.248897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] delete 2f8014d3-9440-4bb8-b0a0-929ac4ada670 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:39:34.271544 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] Created reservations ['a6b27669-dff8-404a-8460-3b02075e252f', 'd41b7079-36e0-4be3-9cb9-2ec7a645ebfe'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:39:34.294323 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-7e375a60-4645-465a-bc02-0072a3c4720a tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup 2f8014d3-9440-4bb8-b0a0-929ac4ada670 deleted. Jul 05 04:39:34.475804 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Create backup started, backup: 9e7881ef-76b3-4cb2-99f7-813f5f2639d4 volume: 2eaadcae-a194-4958-a064-2dd7277af6b1. Jul 05 04:39:34.481282 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:39:34Z,data_timestamp=2026-07-05T04:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004568',id=9e7881ef-76b3-4cb2-99f7-813f5f2639d4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9f3c8a595ac432b8b3cad8d2dc58ebd',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='fbb448ba98aa41fa90356c32cd15db91',volume_id=2eaadcae-a194-4958-a064-2dd7277af6b1) Jul 05 04:39:34.515327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:34.515978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:34.516412 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:34.529317 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:34.549293 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:34.563030 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:34.563357 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:34.571367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:34.575592 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe2a:301b', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab'] Jul 05 04:39:34.575592 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:34.575592 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:34.575592 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:35.085678 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:35.086197 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:35.086412 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:35.086917 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:35.087179 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:39:35.099740 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:35.100429 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:35.100901 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:35.116526 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:39:35.116526 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1] added Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:39:35.129512 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:39:36.132123 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:39:36.144982 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:36.160591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.181011 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.181306 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:36.242748 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] Jul 05 04:39:36.242748 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] successful. Jul 05 04:39:36.242748 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:36.257096 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:36.275286 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:36.275754 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:36.276125 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:36.276125 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:39:36.278942 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] HCTL ('10', '-', '-', 0) found on session 166 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:39:36.279106 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:39:36.304918 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 166 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:39:36.304918 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:39:37.103721 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:37.109720 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Create backup started, backup: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6 volume: d3c33b98-b323-44a4-baa4-ab383dc196e8. Jul 05 04:39:37.115148 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:39:37Z,data_timestamp=2026-07-05T04:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-178362657',encryption_key_id=None,fail_reason=None,host='np0000004568',id=05a8fca9-1a60-46bc-b263-37b7c93d6eb6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6cf0e5a3cf9d496e9844de11fe8f2ca2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='25eb2ff26959420ca620822326107d74',volume_id=d3c33b98-b323-44a4-baa4-ab383dc196e8) Jul 05 04:39:37.139242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:37.139242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:37.139242 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:37.151035 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:37.171380 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:37.186472 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:37.186864 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:37.196506 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:37.197935 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe78:2bbd', 'fe80::f816:3eff:fe2a:301b', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:39:37.198188 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:37.198333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:37.198559 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:37.309386 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.222s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:37.309651 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (2222ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sde'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:37.309993 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:37.327260 np0000004568 sudo[143734]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 04:39:37.328002 np0000004568 sudo[143734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:37.684700 np0000004568 sudo[143734]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:37.686624 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.376s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:37.722758 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:37.723282 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3c33b98-b323-44a4-baa4-ab383dc196e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:37.723518 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:37.724026 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:37.724242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3c33b98-b323-44a4-baa4-ab383dc196e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:39:37.734913 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:37.736077 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:37.736539 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:37.736825 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:37.742819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _create_container started, container: volumebackups,backup: 9e7881ef-76b3-4cb2-99f7-813f5f2639d4. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:39:37.752711 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:39:37.752711 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8] added Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:37.764959 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:37.765275 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:39:37.765718 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:39:37.766032 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:39:37.815426 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] generate_object_name_prefix: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:39:37.822150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] starting backup of volume: 2eaadcae-a194-4958-a064-2dd7277af6b1, volume size: 1073741824, object names prefix volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:39:38.106216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:38.372606 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:38.372606 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:38.489104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:38.489223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:38.769150 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:38.785287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:39:38.786855 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:38.807281 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:38.826614 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:38.827232 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:38.881181 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8, portal: 192.168.40.100,3260] Jul 05 04:39:38.881181 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8, portal: 192.168.40.100,3260] successful. Jul 05 04:39:38.881181 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:38.895524 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:38.912667 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f6da95-0dc0-46b6-b142-0c1a51bfc356 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2da4065d-22e2-4bc8-9bc9-0cc57bcbe8f3 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:38.912994 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:38.913190 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:38.913315 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:39:38.914449 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] HCTL ('11', '-', '-', 0) found on session 167 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:39:38.914578 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:39:38.926727 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 167 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:39:38.928111 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3c33b98-b323-44a4-baa4-ab383dc196e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:39:39.065204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:39.065411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:39.179826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:39.180056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:39.469781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:39.718759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:39.718759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:39.833319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:39.833319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:39.932692 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.206s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:39.932692 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (2207ms) {'type': 'block', 'scsi_wwn': '3300000005fda738d', 'path': '/dev/sdf'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:39.932692 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:39.959709 np0000004568 sudo[143872]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 05 04:39:39.960357 np0000004568 sudo[143872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:40.115257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:40.347888 np0000004568 sudo[143872]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:40.349787 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.418s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:40.359891 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _create_container started, container: volumebackups,backup: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:39:40.395309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] generate_object_name_prefix: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:39:40.401830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:40.401830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:40.406096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] starting backup of volume: d3c33b98-b323-44a4-baa4-ab383dc196e8, volume size: 1073741824, object names prefix volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:39:40.519888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:40.520426 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:40.709666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:40.830108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:40.982841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:40.982841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:41.098435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:41.099248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:41.103959 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:41.104234 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:41.216510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:41.217162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:41.396603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:41.473499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:41.657209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:41.657676 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:41.719472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:41.719678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:41.767840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:41.767996 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:41.830382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:41.830603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:42.040726 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:42.106355 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:42.297653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:42.297857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:42.369045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:42.369226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:42.406507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:42.406729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:42.478936 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:42.479305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:42.650956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:42.735229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:42.903446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:42.903699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:42.982360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:42.982501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:43.004131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:43.004314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:43.094660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:43.094827 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:43.185034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:43.317977 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:43.461671 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:43.461671 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:43.567092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:43.567327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:43.568871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:43.569055 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:43.676767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:43.676767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:43.791410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:43.915041 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:44.086150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:44.086316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:44.188591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:44.188815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:44.202145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:44.202457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:44.318317 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:44.318539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:44.372443 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:44.513310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:44.622648 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:44.622924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:44.756160 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:44.756320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:44.763180 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:44.763370 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:44.877052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:44.877510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:44.939936 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:45.064518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:45.190530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:45.190732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:45.295727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:45.295877 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:45.333270 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:45.333495 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:45.452368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:45.452536 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:45.487720 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:45.635469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:45.738263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:45.738415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:45.837150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:45.837307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:45.876799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:45.876978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:45.980140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:45.980692 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:46.025726 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:46.164460 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:46.281720 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:46.281937 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:46.383935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:46.384102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:46.409156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:46.409399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:46.508387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:46.508621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:46.617558 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:46.716630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:46.870619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:46.871024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:46.961618 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:46.961618 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:46.970415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:46.970415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:47.065880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:47.065880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:47.182429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:47.266655 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:47.428601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:47.428601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:47.512037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:47.512037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:47.529658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:47.529658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:47.617057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:47.617057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:47.744468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:47.832800 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:47.995663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:47.995813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:48.075369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:48.075369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:48.102449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:48.102694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:48.192472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:48.192714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:48.529710 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:48.618133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:48.799555 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:48.799869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:48.875412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:48.875536 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:48.904348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:48.905458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:48.985113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:48.985290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:49.344853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:49.396433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:49.610605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:49.610807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:49.663324 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:49.663440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:49.713838 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:49.714076 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:49.763371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:49.763552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:50.134047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:50.185561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:50.411526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:50.411961 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:50.463556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:50.463805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:50.528416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:50.528654 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:50.578005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:50.578265 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:50.832348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:50.953442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:50.953891 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:50.958156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:51.022053 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:51.022224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:51.035817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:39:51.042563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:39:51.042735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:39:51.047641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:39:51.047868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:39:51.051616 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:39:51.051906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:39:51.132841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:39:51.133529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:39:51.163183 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9e7881ef-76b3-4cb2-99f7-813f5f2639d4",\n "backup_name": null,\n "created_at": "2026-07-05 04:39:34+00:00",\n "objects": [\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2eaadcae-a194-4958-a064-2dd7277af6b1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2eaadcae-a194-4958-a064-2dd7277af6b1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f84855f2e86c4503b4af670e811002ce\\", \\"project_id\\": \\"c9f3c8a595ac432b8b3cad8d2dc58ebd\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:39:15.000000\\", \\"launched_at\\": \\"2026-07-05T04:39:15.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-110896500\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:39:15.000000\\", \\"updated_at\\": \\"2026-07-05T04:39:34.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:39:51.169733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] backup 9e7881ef-76b3-4cb2-99f7-813f5f2639d4 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:39:51.318778 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:51.326787 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:51.327137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:51.346033 np0000004568 sudo[144367]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 04:39:51.346645 np0000004568 sudo[144367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:51.449642 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:51.450125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:51.719677 np0000004568 sudo[144367]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:51.722146 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.403s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:51.723240 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799160', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:51.723240 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:51.785751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:52.042289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:52.042463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:52.140991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:52.141148 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:52.324038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:52.588757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:52.589156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:52.695350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:52.695514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:52.696963 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=179,cinder:UPDATE=48,cinder:INSERT=6 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:39:52.890775 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:53.168540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:53.168780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:53.281285 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:53.281548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:53.374797 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:39:53.499518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:39:53.499770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:39:53.560349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup MD5 for volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:39:53.560529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:39:53.574591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:39:53.589105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:39:53.589433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:39:53.593586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:39:53.593768 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:39:53.596605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:39:53.596860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:39:53.658783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:39:53.659351 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:39:53.680718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "05a8fca9-1a60-46bc-b263-37b7c93d6eb6",\n "backup_name": "tempest-type-Backup-178362657",\n "created_at": "2026-07-05 04:39:37+00:00",\n "objects": [\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d3c33b98-b323-44a4-baa4-ab383dc196e8",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d3c33b98-b323-44a4-baa4-ab383dc196e8\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"25eb2ff26959420ca620822326107d74\\", \\"project_id\\": \\"6cf0e5a3cf9d496e9844de11fe8f2ca2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:39:36.000000\\", \\"launched_at\\": \\"2026-07-05T04:39:36.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1698996049\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:39:36.000000\\", \\"updated_at\\": \\"2026-07-05T04:39:37.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:39:53.685314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] backup 05a8fca9-1a60-46bc-b263-37b7c93d6eb6 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:39:53.812893 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:53.834045 np0000004568 sudo[144562]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 05 04:39:53.834831 np0000004568 sudo[144562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:39:54.123389 np0000004568 sudo[144562]: pam_unix(sudo:session): session closed for user root Jul 05 04:39:54.125943 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.313s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:39:54.126804 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3c33b98-b323-44a4-baa4-ab383dc196e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000005fda738d', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:54.127066 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:54.722144 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.999s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:54.722678 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2eaadcae-a194-4958-a064-2dd7277af6b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.734003 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:54.734841 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:39:54.734841 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:39:54.734841 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:39:54.734841 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.762792 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:54.763126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '173')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:39:54.763423 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1', '166')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:39:54.764286 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fdedd0d120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1'): ({'sde'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:39:54.764487 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sde {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:39:54.774620 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sde {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:39:54.781988 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:39:54.837243 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:39:54.837444 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:39:54.838943 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:39:54.850242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:39:54.850499 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:39:54.861870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:54.894006 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] Jul 05 04:39:54.894006 np0000004568 cinder-backup[101263]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-2eaadcae-a194-4958-a064-2dd7277af6b1, portal: 192.168.40.100,3260] successful. Jul 05 04:39:54.894006 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:54.920177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:54.920177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.196s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:54.920177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (3195ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:54.920177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.793s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:54.920177 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3c33b98-b323-44a4-baa4-ab383dc196e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:39:54.932061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd433b38-2816-4f4e-bb33-761621fe6b43', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '173')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8', '167')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fded7ece00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8'): ({'sdf'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:39:54.962377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sdf {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:39:54.974332 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sdf {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:39:54.983410 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:39:55.031735 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:39:55.031735 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:39:55.031735 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:39:55.042955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:39:55.042955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:39:55.053887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:55.090888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8, portal: 192.168.40.100,3260] Jul 05 04:39:55.090888 np0000004568 cinder-backup[101263]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-d3c33b98-b323-44a4-baa4-ab383dc196e8, portal: 192.168.40.100,3260] successful. Jul 05 04:39:55.090888 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:55.110450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:55.110450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.190s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:39:55.110450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (983ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:55.943094 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-09da7c71-8c50-4098-9d63-a110b76fd356 tempest-ProjectMemberTests33-954956515 None] Create backup finished. backup: 9e7881ef-76b3-4cb2-99f7-813f5f2639d4. Jul 05 04:39:56.126855 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0e0f936e-0a37-4944-910c-0813d8be340d tempest-ProjectAdminTests33-1174657105 None] Create backup finished. backup: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6. Jul 05 04:39:56.569973 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-271fdf31-ae46-4e2c-8358-9db5eaebe461 tempest-ProjectAdminTests33-1174657105 None] Reset backup status started, backup_id: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6, status: error. Jul 05 04:39:56.569973 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-271fdf31-ae46-4e2c-8358-9db5eaebe461 tempest-ProjectAdminTests33-1174657105 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 05 04:39:56.980810 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] Delete backup started, backup: 9e7881ef-76b3-4cb2-99f7-813f5f2639d4. Jul 05 04:39:56.993606 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:56.994141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:56.994617 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] delete started, backup: 9e7881ef-76b3-4cb2-99f7-813f5f2639d4, container: volumebackups, prefix: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:39:57.041295 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00001', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00002', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00003', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00004', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00005', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00006', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00007', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00008', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00009', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00010', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00011', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00012', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00013', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00014', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00015', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00016', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00017', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00018', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00019', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00020', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00021', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_metadata', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:39:57.060970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.085627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.112482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.133919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.155087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.175485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.200857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.225257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.244054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.261913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.281770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.298888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.315937 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.343861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.365284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.386109 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.407059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.426503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.443139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.462606 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.482283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.512696 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.531401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043937/az_nova_backup_9e7881ef-76b3-4cb2-99f7-813f5f2639d4_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:39:57.531610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] delete 9e7881ef-76b3-4cb2-99f7-813f5f2639d4 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:39:57.562211 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:57.576825 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] Created reservations ['4f2c2930-5d5a-4b63-8dbf-6bec5c90dfce', 'b26ce4be-678c-4ad0-ae34-b91c0c204b65'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:39:57.589581 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1cc62d60-f300-41e0-9752-6d36b6380234 tempest-ProjectMemberTests33-954956515 None] Delete backup finished, backup 9e7881ef-76b3-4cb2-99f7-813f5f2639d4 deleted. Jul 05 04:39:58.346023 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Create backup started, backup: 3587f6df-a9fa-4282-8424-538663ad5dc0 volume: 14f58418-d91f-4c4e-a809-d564b1398f13. Jul 05 04:39:58.350508 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:39:58Z,data_timestamp=2026-07-05T04:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-2116835472',encryption_key_id=None,fail_reason=None,host='np0000004568',id=3587f6df-a9fa-4282-8424-538663ad5dc0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9f3c8a595ac432b8b3cad8d2dc58ebd',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f84855f2e86c4503b4af670e811002ce',volume_id=14f58418-d91f-4c4e-a809-d564b1398f13) Jul 05 04:39:58.378608 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:58.379010 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:58.379295 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:58.389446 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:58.410450 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:58.424385 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:58.424807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:58.431760 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:58.433089 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:39:58.433258 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:58.433396 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:58.433709 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:58.848125 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Restore backup started, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4 volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. Jul 05 04:39:58.898170 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:39:58.910753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:39:58.910904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:39:58.911312 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:58.922188 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:39:58.938330 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:58.938774 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14f58418-d91f-4c4e-a809-d564b1398f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:58.939002 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:58.939543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:58.939859 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14f58418-d91f-4c4e-a809-d564b1398f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:39:58.945978 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:39:58.955270 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:58.956078 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:39:58.956378 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:58.962298 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:39:58.963300 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:39:58.968884 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:39:58.968884 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:58.973940 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:39:58.975341 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe47:8fd2', 'fe80::6cff:64ff:fe5d:d38f', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999', 'fe80::f816:3eff:fe43:e7ef', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:39:58.975540 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:39:58.975751 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:39:58.976058 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13] added Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:39:58.980813 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:39:58.981019 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:39:58.981327 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:39:58.981546 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:39:59.982842 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:39:59.983504 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:39:59.984034 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91d30402-35ff-4618-92c2-243f92b8cf0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:39:59.984256 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:39:59.994858 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:00.005888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.021826 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:00.065075 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13, portal: 192.168.40.100,3260] Jul 05 04:40:00.065075 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13, portal: 192.168.40.100,3260] successful. Jul 05 04:40:00.065075 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:00.075400 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:00.090483 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:00.090782 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:00.090962 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:00.091098 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:00.091984 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] HCTL ('9', '-', '-', 0) found on session 174 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:00.092113 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:00.104774 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 174 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:00.104892 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14f58418-d91f-4c4e-a809-d564b1398f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:00.302283 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:40:00.302548 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:40:01.107471 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:01.107982 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (2168ms) {'type': 'block', 'scsi_wwn': '3300000009559dc11', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:01.107982 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:01.114077 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.129s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:01.114498 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91d30402-35ff-4618-92c2-243f92b8cf0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:01.124515 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:01.124959 np0000004568 sudo[144812]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:40:01.125381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:01.125381 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:01.125556 np0000004568 sudo[144812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:01.135198 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:01.135198 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e] added Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:01.145179 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:01.145352 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:01.145700 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:01.145881 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:01.478153 np0000004568 sudo[144812]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:01.479784 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.372s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:01.523820 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:01.530940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _create_container started, container: volumebackups,backup: 3587f6df-a9fa-4282-8424-538663ad5dc0. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:40:01.557515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] generate_object_name_prefix: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:40:01.561849 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] starting backup of volume: 14f58418-d91f-4c4e-a809-d564b1398f13, volume size: 1073741824, object names prefix volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:40:01.765167 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:02.047848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:02.048023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:02.146860 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:02.149031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:02.149644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:02.157988 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:02.170087 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:02.186970 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:02.235880 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e, portal: 192.168.40.100,3260] Jul 05 04:40:02.235880 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e, portal: 192.168.40.100,3260] successful. Jul 05 04:40:02.235880 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:02.245970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e (non-flash) Jul 05 04:40:02.265358 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4a40b85-2372-4bef-8e6b-84e91043f675 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1deddce3-cff4-4dfa-a4a0-cb4e67ec80b2 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e (non-flash) Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:02.266682 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:02.267971 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] HCTL ('10', '-', '-', 0) found on session 175 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:02.267971 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:02.286372 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 175 and hctl ['10', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:02.325758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:02.571121 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:02.571242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:02.672610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:02.672791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:02.847497 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:03.112064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:03.112307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:03.221025 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:03.221515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:03.284251 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Searching for a device in session 175 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:03.284477 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91d30402-35ff-4618-92c2-243f92b8cf0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:03.285107 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.172s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:03.285282 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] <== connect_volume: return (3300ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799166', 'path': '/dev/sde'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:03.285636 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:03.312409 np0000004568 sudo[144919]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 05 04:40:03.313270 np0000004568 sudo[144919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:03.436066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:03.656736 np0000004568 sudo[144919]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:03.658587 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.373s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:03.659197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] starting restore of backup volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4 container: volumebackups, to new volume 91d30402-35ff-4618-92c2-243f92b8cf0e, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:40:03.659497 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] _read_metadata started, container name: volumebackups, metadata filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:40:03.678112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:03.678369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] _read_metadata finished. Metadata: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "backup_id": "7f35d128-ec48-4f10-886f-6c547cf61dc4", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "backup_name": "tempest-type-Backup-1908889847", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:38:15+00:00", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021": { Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: ], Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_id": "e577af87-606d-4116-a3c2-cf12b90b0ab9", Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"e577af87-606d-4116-a3c2-cf12b90b0ab9\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"25eb2ff26959420ca620822326107d74\", \"project_id\": \"6cf0e5a3cf9d496e9844de11fe8f2ca2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:38:14.000000\", \"launched_at\": \"2026-07-05T04:38:14.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-432062379\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:38:13.000000\", \"updated_at\": \"2026-07-05T04:38:15.000000\"}}" Jul 05 04:40:03.683999 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:40:03.691438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:40:03.691438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] _read_metadata started, container name: volumebackups, metadata filename: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] _read_metadata finished. Metadata: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "backup_id": "7f35d128-ec48-4f10-886f-6c547cf61dc4", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "backup_name": "tempest-type-Backup-1908889847", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:38:15+00:00", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021": { Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: } Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: ], Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_id": "e577af87-606d-4116-a3c2-cf12b90b0ab9", Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"e577af87-606d-4116-a3c2-cf12b90b0ab9\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"25eb2ff26959420ca620822326107d74\", \"project_id\": \"6cf0e5a3cf9d496e9844de11fe8f2ca2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:38:14.000000\", \"launched_at\": \"2026-07-05T04:38:14.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-432062379\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:38:13.000000\", \"updated_at\": \"2026-07-05T04:38:15.000000\"}}" Jul 05 04:40:03.714951 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:40:03.719851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] v1 volume backup restore of 7f35d128-ec48-4f10-886f-6c547cf61dc4 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:40:03.719851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] metadata_object_names = ['volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:40:03.774128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:03.782791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:03.797168 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:03.797875 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:03.802366 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:03.975563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:04.155960 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:04.170003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:04.256509 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:04.256880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:04.364213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:04.364393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:04.546073 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:04.566886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:04.923059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:04.938956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:04.940729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:05.283222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:05.283622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:05.289815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:05.303345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:05.394560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:05.394756 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:05.646042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:05.660200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:05.681884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:05.984991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:05.985119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:05.990754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:06.008024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:06.089881 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:06.090069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:06.378020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:06.391390 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:06.416694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:06.721586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:06.721801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:06.726556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:06.743955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:06.832102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:06.832271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:07.072927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:07.088941 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:07.121972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:07.412904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:07.413553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:07.418973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:07.435341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:07.520467 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:07.520627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:07.773660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:07.796699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:07.811698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:08.153219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:08.153414 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:08.159114 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:08.176640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:08.254590 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:08.254828 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:08.515992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:08.529844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:08.552019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:08.845601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:08.845874 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:08.851712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:08.867612 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:08.957797 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:08.957969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:09.206724 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:09.224155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:09.246998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:09.553796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:09.554181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:09.560414 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:09.585754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:09.667739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:09.667904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:09.922234 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:09.950779 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:09.963177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:10.276863 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:10.277028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:10.282052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:10.297799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:10.378205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:10.378350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:10.638798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:10.653768 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:10.673746 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:10.975788 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:10.975974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:10.981490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restoring object. backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, object name: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021, volume: 91d30402-35ff-4618-92c2-243f92b8cf0e. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:40:10.996763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:40:11.090418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:11.090698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:11.166470 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] v1 volume backup restore of 7f35d128-ec48-4f10-886f-6c547cf61dc4 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:40:11.166831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:40:11.173129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Excluding field 'display_name' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:40:11.173302 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Excluding field 'display_description' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:40:11.178604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:40:11.178845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:40:11.179107 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] restore 7f35d128-ec48-4f10-886f-6c547cf61dc4 to 91d30402-35ff-4618-92c2-243f92b8cf0e finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:40:11.179541 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:11.199319 np0000004568 sudo[145173]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 05 04:40:11.199980 np0000004568 sudo[145173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:11.346486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:11.501497 np0000004568 sudo[145173]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:11.503166 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.324s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:11.503796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91d30402-35ff-4618-92c2-243f92b8cf0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799166', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:11.504009 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:11.504539 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:11.504974 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91d30402-35ff-4618-92c2-243f92b8cf0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:11.515910 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:11.516531 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:11.516531 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:11.516531 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:11.516531 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:11.549591 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:11.549844 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:11.550095 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9', '177')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:11.550189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e', '175')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:11.551280 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Resulting device map defaultdict(. at 0x77fded96d3a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e'): ({'sde'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:11.551496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Removing single pathed devices sde {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:11.562808 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Flushing IO for device /dev/sde {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:11.570160 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:11.592836 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:11.592995 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:11.611201 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:11.611468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] SCSI volumes sde have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:11.612903 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:11.623526 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:11.623800 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:11.636154 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:11.667474 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e, portal: 192.168.40.100,3260] Jul 05 04:40:11.667474 np0000004568 cinder-backup[101263]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-91d30402-35ff-4618-92c2-243f92b8cf0e, portal: 192.168.40.100,3260] successful. Jul 05 04:40:11.667474 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:11.686424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:11.686767 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:11.686974 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] <== disconnect_volume: return (183ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:11.697249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:11.697249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:11.896839 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:12.136997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:12.137159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:12.236183 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:12.236364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:12.442922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:12.698964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Encryption key ID for volume 91d30402-35ff-4618-92c2-243f92b8cf0e already matches encryption key ID in backup 7f35d128-ec48-4f10-886f-6c547cf61dc4. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:40:12.700320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:12.700320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:12.721830 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-59d4465c-22a1-465d-abb9-efa17a2dda9d tempest-ProjectAdminTests33-1174657105 None] Finished restoring backup 7f35d128-ec48-4f10-886f-6c547cf61dc4 to volume 91d30402-35ff-4618-92c2-243f92b8cf0e. Jul 05 04:40:12.803980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:12.804142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:13.014245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:13.263001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:13.263153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:13.360882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:13.360997 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:13.557472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:13.803856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:13.804253 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:13.919473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:13.919473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:14.111753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:14.279192 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6. Jul 05 04:40:14.286622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:14.286622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:14.286848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] delete started, backup: 05a8fca9-1a60-46bc-b263-37b7c93d6eb6, container: volumebackups, prefix: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:40:14.333282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00001', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00002', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00003', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00004', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00005', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00006', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00007', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00008', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00009', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00010', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00011', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00012', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00013', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00014', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00015', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00016', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00017', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00018', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00019', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00020', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00021', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_metadata', 'volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:14.360232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.379119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:14.379554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:14.382957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.421661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.447071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.473298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.494213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.502381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:14.502614 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:14.532440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.540454 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:14.553275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.574491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.595282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.614248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.632603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.644051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:14.653347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.676130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.703598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.727385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.749644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.770907 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.773738 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:14.773874 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:14.795561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.815368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.836240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:14.836502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:14.839580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.847594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:40:14.854409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:40:14.854593 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:40:14.857969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:40:14.858170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:40:14.861058 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:40:14.861296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:40:14.876956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.899001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_d3c33b98-b323-44a4-baa4-ab383dc196e8/20260705043940/az_nova_backup_05a8fca9-1a60-46bc-b263-37b7c93d6eb6_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:14.899242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] delete 05a8fca9-1a60-46bc-b263-37b7c93d6eb6 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:40:14.911864 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] Created reservations ['527c6dc3-ec10-4b2d-ad63-9dbb5e6bd5a0', '68dba3fb-bfc1-49da-a81e-271230d22303'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:40:14.920289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:40:14.920945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _write_metadata started, container name: volumebackups, metadata filename: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:40:14.929216 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9dddd153-3614-4c69-9a53-2d814bf0094f tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup 05a8fca9-1a60-46bc-b263-37b7c93d6eb6 deleted. Jul 05 04:40:14.944851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3587f6df-a9fa-4282-8424-538663ad5dc0",\n "backup_name": "tempest-type-Backup-2116835472",\n "created_at": "2026-07-05 04:39:58+00:00",\n "objects": [\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "14f58418-d91f-4c4e-a809-d564b1398f13",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"14f58418-d91f-4c4e-a809-d564b1398f13\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f84855f2e86c4503b4af670e811002ce\\", \\"project_id\\": \\"c9f3c8a595ac432b8b3cad8d2dc58ebd\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:39:57.000000\\", \\"launched_at\\": \\"2026-07-05T04:39:57.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1443689006\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:39:57.000000\\", \\"updated_at\\": \\"2026-07-05T04:39:58.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:40:14.948992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] backup 3587f6df-a9fa-4282-8424-538663ad5dc0 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:40:15.072943 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:15.090743 np0000004568 sudo[145246]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:40:15.091346 np0000004568 sudo[145246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:15.360766 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0. Jul 05 04:40:15.367552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:15.367917 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:15.368333 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] delete started, backup: b4d07921-a7f9-4114-b755-c4fd268ad3d0, container: volumebackups, prefix: volume_d5f97f7d-6713-4139-910b-8c11cf624c05/20260705043915/az_nova_backup_b4d07921-a7f9-4114-b755-c4fd268ad3d0. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:40:15.393551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] generated object list: []. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:15.393738 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] delete b4d07921-a7f9-4114-b755-c4fd268ad3d0 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:40:15.401821 np0000004568 sudo[145246]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:15.430617 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.358s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:15.430987 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14f58418-d91f-4c4e-a809-d564b1398f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000009559dc11', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:15.431218 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:15.431778 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:15.432289 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '14f58418-d91f-4c4e-a809-d564b1398f13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:15.439784 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:15.445979 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:15.446523 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:15.446523 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:15.446523 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:15.446523 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:15.458672 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] Created reservations ['65c34950-3175-4c74-af80-7de4e3855847', 'd7f0b062-a511-4a13-89f7-70e8c218f73b'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:15.474508 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13 (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:15.474768 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:15.474924 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed92a646-7105-4602-aca2-40b2d8d74d1b', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9', '177')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:15.474987 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13', '174')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:15.475849 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fe0bf2e700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:15.476064 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:15.479652 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-24aeb740-ff7d-4061-82a4-8b3e37190d52 tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup b4d07921-a7f9-4114-b755-c4fd268ad3d0 deleted. Jul 05 04:40:15.488072 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:15.496165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:15.537167 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:15.537364 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:15.538480 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:15.548200 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:15.548415 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:15.558532 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:15.591665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13, portal: 192.168.40.100,3260] Jul 05 04:40:15.591665 np0000004568 cinder-backup[101263]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-14f58418-d91f-4c4e-a809-d564b1398f13, portal: 192.168.40.100,3260] successful. Jul 05 04:40:15.591665 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:15.606397 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:15.606765 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.175s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:15.606975 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (176ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:16.426029 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] Delete backup started, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4. Jul 05 04:40:16.429231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6cf0e5a3cf9d496e9844de11fe8f2ca2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:16.429400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:16.429556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] delete started, backup: 7f35d128-ec48-4f10-886f-6c547cf61dc4, container: volumebackups, prefix: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:40:16.470898 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] generated object list: ['volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata', 'volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:16.492967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.510610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.530429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.549140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.569633 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.589737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.608874 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.670487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.679335 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:16.689183 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Create backup started, backup: e516b5b4-0089-43db-b51f-2227f70059a7 volume: 27ae2de2-ca84-4efa-9ead-e523e6587aff. Jul 05 04:40:16.690697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.696949 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:40:16Z,data_timestamp=2026-07-05T04:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1944246081',encryption_key_id=None,fail_reason=None,host='np0000004568',id=e516b5b4-0089-43db-b51f-2227f70059a7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6360a30b620f4cef8c6c25f25bd3c0f7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f8efc89b441d4544bf4877ef3bb3e89e',volume_id=27ae2de2-ca84-4efa-9ead-e523e6587aff) Jul 05 04:40:16.699375 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-918ee310-1ac7-4b0f-b954-dbcd6e161864 tempest-ProjectMemberTests33-954956515 None] Create backup finished. backup: 3587f6df-a9fa-4282-8424-538663ad5dc0. Jul 05 04:40:16.712700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.724232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6360a30b620f4cef8c6c25f25bd3c0f7 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:16.724434 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:16.724765 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:16.732285 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.737759 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:40:16.751916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.757848 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:16.771528 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:40:16.771819 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:40:16.774834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.779809 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:40:16.781210 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:40:16.781346 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:40:16.781480 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:40:16.781732 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:16.801255 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] Delete backup started, backup: 3587f6df-a9fa-4282-8424-538663ad5dc0. Jul 05 04:40:16.802418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:16.802609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:16.802808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] delete started, backup: 3587f6df-a9fa-4282-8424-538663ad5dc0, container: volumebackups, prefix: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:40:16.806879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.833758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.846743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00001', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00002', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00003', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00004', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00005', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00006', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00007', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00008', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00009', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00010', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00011', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00012', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00013', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00014', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00015', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00016', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00017', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00018', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00019', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00020', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00021', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_metadata', 'volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:16.854585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.865697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.873469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.885050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.892927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.906066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.911583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.923078 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.930297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.941346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.948391 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.960059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.965028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.985177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.986749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] deleted object: volume_e577af87-606d-4116-a3c2-cf12b90b0ab9/20260705043818/az_nova_backup_7f35d128-ec48-4f10-886f-6c547cf61dc4_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:16.988277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] delete 7f35d128-ec48-4f10-886f-6c547cf61dc4 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:40:17.021900 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:17.030917 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.037251 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] Created reservations ['59531aed-6843-46b3-bb3e-0339320cac5e', '3fa4a26b-ad26-4696-a62f-eea66741708f'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:40:17.049544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.055642 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-93995900-19f1-45b5-8322-5c5066cf1495 tempest-ProjectAdminTests33-1174657105 None] Delete backup finished, backup 7f35d128-ec48-4f10-886f-6c547cf61dc4 deleted. Jul 05 04:40:17.067646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.084233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.102037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.120918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.141486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.157801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.176367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.196163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.212714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.229118 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.247126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.264600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.280523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.286999 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:40:17.287382 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27ae2de2-ca84-4efa-9ead-e523e6587aff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:17.287561 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:17.287947 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:17.288143 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27ae2de2-ca84-4efa-9ead-e523e6587aff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:17.298220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_14f58418-d91f-4c4e-a809-d564b1398f13/20260705044001/az_nova_backup_3587f6df-a9fa-4282-8424-538663ad5dc0_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:17.298409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] delete 3587f6df-a9fa-4282-8424-538663ad5dc0 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:40:17.300561 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:17.300920 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:17.301119 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:17.311096 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:17.311096 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:17.311963 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] Created reservations ['5b7726cf-e6d9-4153-b2e0-f016299c7bc5', 'c86c4967-27e7-4aad-a11e-c580c114c17a'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff] added Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:17.322160 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:17.322443 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:17.322632 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0214(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:17.322811 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:17.326179 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-33e6750a-1505-4cd7-a4f3-225b210bc345 tempest-ProjectMemberTests33-954956515 None] Delete backup finished, backup 3587f6df-a9fa-4282-8424-538663ad5dc0 deleted. Jul 05 04:40:18.323703 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:18.334888 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:18.344712 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:18.357255 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.357255 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.357255 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.357255 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.357255 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:18.357459 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.357459 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.357459 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.357459 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.357459 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:18.389368 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff, portal: 192.168.40.100,3260] Jul 05 04:40:18.389368 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff, portal: 192.168.40.100,3260] successful. Jul 05 04:40:18.389368 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:18.400274 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:18.413413 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:18.413654 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:18.413911 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:18.414108 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:18.414816 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] HCTL ('9', '-', '-', 0) found on session 178 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:18.414945 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:18.429807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Searching for a device in session 178 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:18.429807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27ae2de2-ca84-4efa-9ead-e523e6587aff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:19.205778 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Create backup started, backup: 909393fb-dc4b-4bac-8923-a95706acd8f3 volume: 419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54. Jul 05 04:40:19.212719 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:40:19Z,data_timestamp=2026-07-05T04:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1564881759',encryption_key_id=None,fail_reason=None,host='np0000004568',id=909393fb-dc4b-4bac-8923-a95706acd8f3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9f3c8a595ac432b8b3cad8d2dc58ebd',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f84855f2e86c4503b4af670e811002ce',volume_id=419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54) Jul 05 04:40:19.256825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:19.257008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:19.257264 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:19.269530 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:40:19.296657 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:19.310424 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:40:19.310769 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:40:19.320661 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:40:19.321826 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe22:55b6', 'fe80::50d9:a9ff:fefc:c0ab', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:40:19.322072 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:40:19.322190 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:40:19.322511 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:19.432261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.144s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:19.432733 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] <== connect_volume: return (2144ms) {'type': 'block', 'scsi_wwn': '330000000b9c9c575', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:19.432844 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:19.449795 np0000004568 sudo[145407]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:40:19.450392 np0000004568 sudo[145407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:19.747670 np0000004568 sudo[145407]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:19.749913 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.316s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:19.788734 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:19.794493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _create_container started, container: volumebackups,backup: e516b5b4-0089-43db-b51f-2227f70059a7. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:40:19.826587 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:40:19.827083 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:19.827305 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:19.996381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] generate_object_name_prefix: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:40:20.001430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] starting backup of volume: 27ae2de2-ca84-4efa-9ead-e523e6587aff, volume size: 1073741824, object names prefix volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:40:20.178970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:20.427423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:20.427423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:20.530589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:20.530589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:20.714661 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:20.967070 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:20.967232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:21.074018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:21.074258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:21.271350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:21.524273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:21.524461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:21.621706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:21.622049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:21.828120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:22.076133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:22.076279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:22.177312 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:22.177439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:22.353595 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:22.596178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:22.596499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:22.602303 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.775s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:22.602695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:22.618596 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:22.619614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:22.619614 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:22.629836 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:22.629836 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54] added Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:22.638730 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:22.638978 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:22.639382 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0202(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:22.639722 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:22.702828 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:22.703094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:22.880705 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:23.128185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:23.129605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:23.226464 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:23.226625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:23.400044 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:23.640315 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:23.649498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:23.649695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:23.652013 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:23.662259 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.679828 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.683939 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:23.723058 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, portal: 192.168.40.100,3260] Jul 05 04:40:23.723058 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, portal: 192.168.40.100,3260] successful. Jul 05 04:40:23.723058 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:23.735030 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:23.750782 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-91a17571-90a8-48b6-98d5-ba4548385ee9 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19cf2d70-42d9-45b5-bc25-c8ddbab75b23 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:23.751072 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:23.751249 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:23.751375 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:23.752230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] HCTL ('12', '-', '-', 0) found on session 181 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:23.752353 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:23.753536 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:23.753685 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:23.777099 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 181 and hctl ['12', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:23.953134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:24.196823 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:24.197005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:24.300013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:24.300178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:24.483808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:24.734577 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:24.734934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:24.778104 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 181 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:24.778285 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:24.778896 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.177s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:24.779074 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (4951ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799174', 'path': '/dev/sdg'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:24.779363 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:24.799154 np0000004568 sudo[145675]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 04:40:24.799796 np0000004568 sudo[145675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:24.841767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:24.842793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:25.030345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:25.100979 np0000004568 sudo[145675]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:25.102745 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.323s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:25.109442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _create_container started, container: volumebackups,backup: 909393fb-dc4b-4bac-8923-a95706acd8f3. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:40:25.144847 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] generate_object_name_prefix: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:40:25.154921 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] starting backup of volume: 419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, volume size: 1073741824, object names prefix volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:40:25.303144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:25.303280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:25.331832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:25.408760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:25.408953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:25.571548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:25.667258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:25.667435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:25.764059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:25.764471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:25.821237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:25.821505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:25.923193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:25.923379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:25.942592 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:26.102598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:26.195016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:26.195108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:26.294060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:26.294239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:26.347075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:26.347334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:26.446546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:26.446845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:26.511139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:26.645822 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:26.753493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:26.753700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:26.852688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:26.853099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:26.895512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:26.895748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:26.998122 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:26.998307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:27.036532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:27.204006 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:27.287412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:27.287612 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:27.385486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:27.385710 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:27.443757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:27.443907 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:27.544637 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:27.544864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:27.602679 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:27.756123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:27.854827 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:27.855275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:27.961513 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:27.961686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:28.001643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:28.001804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:28.101007 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:28.101200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:28.128908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:28.276699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:28.390020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:28.390188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:28.492324 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:28.492516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:28.518432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:28.518707 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:29.085548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:29.094473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:29.094662 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:29.198536 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:29.198723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:29.280916 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:29.403818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:29.530164 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:29.530328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:29.629087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:29.629213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:29.652017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:29.652548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:29.754852 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:29.755124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:29.814027 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:29.954423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:30.070075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:30.070310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:30.170411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:30.170818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:30.207625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:30.207867 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:30.307812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:30.307956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:30.358067 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:30.482667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:30.603031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:30.603182 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:30.708505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:30.708694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:30.725235 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:30.725435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:30.825778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:30.825957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:30.928256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:30.939802 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:31.064488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:31.064488 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:31.139388 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup MD5 for volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:31.139447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:31.147233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:40:31.155097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:40:31.155348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:40:31.160453 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:40:31.160691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:40:31.166135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:40:31.166409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:40:31.187552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:31.187940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:31.244264 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:40:31.245234 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _write_metadata started, container name: volumebackups, metadata filename: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:40:31.272871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "e516b5b4-0089-43db-b51f-2227f70059a7",\n "backup_name": "tempest-type-Backup-1944246081",\n "created_at": "2026-07-05 04:40:17+00:00",\n "objects": [\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "27ae2de2-ca84-4efa-9ead-e523e6587aff",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"27ae2de2-ca84-4efa-9ead-e523e6587aff\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f8efc89b441d4544bf4877ef3bb3e89e\\", \\"project_id\\": \\"6360a30b620f4cef8c6c25f25bd3c0f7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:40:16.000000\\", \\"launched_at\\": \\"2026-07-05T04:40:16.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-119808359\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:40:15.000000\\", \\"updated_at\\": \\"2026-07-05T04:40:17.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:40:31.283023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] backup e516b5b4-0089-43db-b51f-2227f70059a7 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:40:31.407329 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:31.415554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:31.415784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:31.433177 np0000004568 sudo[146098]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:40:31.434085 np0000004568 sudo[146098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:31.608392 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:31.792055 np0000004568 sudo[146098]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:31.794149 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.387s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:31.794868 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27ae2de2-ca84-4efa-9ead-e523e6587aff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000b9c9c575', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:31.795105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:31.795658 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:31.796151 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27ae2de2-ca84-4efa-9ead-e523e6587aff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:31.809033 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:31.809730 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:31.809730 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:31.809730 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:31.809730 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:31.837375 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8 (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:31.837787 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a2929a-2ea9-43a6-87d2-dcb6d8d303b8', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c', '185')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:31.838105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff', '178')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:31.838913 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Resulting device map defaultdict(. at 0x77fded9f98a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:31.839106 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:31.852731 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:31.853032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:31.853196 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:31.863517 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:31.911921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:31.912135 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:31.913306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:31.926231 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:31.926508 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:31.938090 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:31.970840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:31.970964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:31.977359 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff, portal: 192.168.40.100,3260] Jul 05 04:40:31.977359 np0000004568 cinder-backup[101263]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-27ae2de2-ca84-4efa-9ead-e523e6587aff, portal: 192.168.40.100,3260] successful. Jul 05 04:40:31.977359 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:31.994429 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:31.994724 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:31.994901 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] <== disconnect_volume: return (200ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:32.199153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:32.463270 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:32.463534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:32.567287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:32.567508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:32.743951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:32.998499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:32.998734 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:33.016236 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-41bc72aa-34f2-402b-8270-15aa6dc7a3c9 tempest-ProjectMemberTests39-951070030 None] Create backup finished. backup: e516b5b4-0089-43db-b51f-2227f70059a7. Jul 05 04:40:33.105245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:33.105431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:33.320899 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:33.588859 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:33.589533 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:33.698007 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:33.698216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:33.948042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:34.169100 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] Delete backup started, backup: e516b5b4-0089-43db-b51f-2227f70059a7. Jul 05 04:40:34.177516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_6360a30b620f4cef8c6c25f25bd3c0f7 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:34.177954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:34.178756 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] delete started, backup: e516b5b4-0089-43db-b51f-2227f70059a7, container: volumebackups, prefix: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:40:34.214549 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:34.214638 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:34.235547 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] generated object list: ['volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00001', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00002', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00003', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00004', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00005', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00006', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00007', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00008', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00009', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00010', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00011', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00012', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00013', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00014', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00015', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00016', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00017', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00018', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00019', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00020', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00021', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_metadata', 'volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:40:34.258908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.281386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.302560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.328217 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:34.328668 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:34.372233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.385290 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:34.398698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.422560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.447379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.470014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.491597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.511976 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.535175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.555751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.575508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.587087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:34.597309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.618457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.639055 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.659050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.679735 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.702810 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.734594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.779415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.809963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.837326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:34.837326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:34.842008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] deleted object: volume_27ae2de2-ca84-4efa-9ead-e523e6587aff/20260705044019/az_nova_backup_e516b5b4-0089-43db-b51f-2227f70059a7_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:40:34.842298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] delete e516b5b4-0089-43db-b51f-2227f70059a7 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:40:34.860905 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] Created reservations ['0b3f69db-f10e-4253-b9c4-2428dc1e3656', '39f8fb7f-8cdf-4981-9e14-9d9dcae0a4f1'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:40:34.885262 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-996085ad-a361-4d97-b40a-f1b86768b2b0 tempest-ProjectMemberTests39-951070030 None] Delete backup finished, backup e516b5b4-0089-43db-b51f-2227f70059a7 deleted. Jul 05 04:40:34.948958 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:34.949151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:35.134603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:35.409155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:35.409503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:35.516230 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:35.516407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:35.727643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:35.998518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:35.998769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:36.100767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:36.100942 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:36.311915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:36.569734 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:36.570159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:36.680120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:36.680361 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:36.789647 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:36.909394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:36.910118 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:36.981352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:36.981432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:36.989034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:40:36.994901 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:40:36.995910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:40:36.999202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:40:36.999360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:40:37.002152 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:40:37.002437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:40:37.070789 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:40:37.071393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _write_metadata started, container name: volumebackups, metadata filename: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:40:37.096656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "909393fb-dc4b-4bac-8923-a95706acd8f3",\n "backup_name": "tempest-type-Backup-1564881759",\n "created_at": "2026-07-05 04:40:19+00:00",\n "objects": [\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f84855f2e86c4503b4af670e811002ce\\", \\"project_id\\": \\"c9f3c8a595ac432b8b3cad8d2dc58ebd\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:40:18.000000\\", \\"launched_at\\": \\"2026-07-05T04:40:18.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1485651416\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:40:18.000000\\", \\"updated_at\\": \\"2026-07-05T04:40:19.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:40:37.101786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] backup 909393fb-dc4b-4bac-8923-a95706acd8f3 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:40:37.238027 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:37.268908 np0000004568 sudo[146779]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 04:40:37.269803 np0000004568 sudo[146779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:37.619784 np0000004568 sudo[146779]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:37.625139 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.384s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:37.625817 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799174', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:37.627044 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:37.627870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:37.628406 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:37.643391 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:37.643817 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:37.643817 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:37.643817 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:37.644590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:37.675710 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54 (non-flash) Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:37.675943 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:37.676089 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c', '185')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:37.676226 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54', '181')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:37.677165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fdedd37ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54'): ({'sdg'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:37.677403 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sdg {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:37.687731 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sdg {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:37.699330 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:37.756356 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:37.756528 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] SCSI volumes sdg have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:37.757759 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:37.772665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:37.773447 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:37.783767 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:37.815204 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, portal: 192.168.40.100,3260] Jul 05 04:40:37.815204 np0000004568 cinder-backup[101263]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54, portal: 192.168.40.100,3260] successful. Jul 05 04:40:37.815204 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:37.829307 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:37.829660 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.202s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:37.829831 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (204ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:38.847284 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8e3af58b-a753-4450-8447-8c5b0cdafff0 tempest-ProjectMemberTests33-954956515 None] Create backup finished. backup: 909393fb-dc4b-4bac-8923-a95706acd8f3. Jul 05 04:40:39.652990 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Create backup started, backup: 1f15fe19-1d18-471a-b46c-ae2822b343c7 volume: fe5e43c0-6db9-4ac8-a612-97e4a7d1c725. Jul 05 04:40:39.658146 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:40:39Z,data_timestamp=2026-07-05T04:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-2025607111',encryption_key_id=None,fail_reason=None,host='np0000004568',id=1f15fe19-1d18-471a-b46c-ae2822b343c7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='216632b7c396473ca082a2f35841e3d2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='06b29084a0f348b48324a2987b92415c',volume_id=fe5e43c0-6db9-4ac8-a612-97e4a7d1c725) Jul 05 04:40:39.666897 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-91d67d05-6f89-44dc-90f5-0258f92efe89 tempest-ProjectMemberTests33-954956515 None] Export record started, backup: 909393fb-dc4b-4bac-8923-a95706acd8f3. Jul 05 04:40:39.672672 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-91d67d05-6f89-44dc-90f5-0258f92efe89 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:39.673118 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-91d67d05-6f89-44dc-90f5-0258f92efe89 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:39.673488 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-91d67d05-6f89-44dc-90f5-0258f92efe89 tempest-ProjectMemberTests33-954956515 None] Export record finished, backup 909393fb-dc4b-4bac-8923-a95706acd8f3 exported. Jul 05 04:40:39.707994 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:39.715577 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:39.715761 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:39.716048 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:39.725858 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:40:39.744783 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:39.756835 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:40:39.757126 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:40:39.764090 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:40:39.765011 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999'] Jul 05 04:40:39.765165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:40:39.765286 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:40:39.765515 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:40.268984 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:40:40.269416 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:40.269615 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:40.925916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.656s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:40.926728 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:40.935934 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:40.936208 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:40.936431 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:40.946158 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:40.946158 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725] added Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:40.955807 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:40.956125 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:40.956303 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0198(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:40.956583 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:41.957589 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:41.969071 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:41.979429 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:41.994183 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:41.994395 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:42.030634 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, portal: 192.168.40.100,3260] Jul 05 04:40:42.030634 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, portal: 192.168.40.100,3260] successful. Jul 05 04:40:42.030634 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:42.040762 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6bb4ef98-4f04-487c-99e9-5c7214d0a693 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:42.054478 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:42.055132 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:42.055345 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] HCTL ('9', '-', '-', 0) found on session 188 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:42.055470 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:42.066807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Searching for a device in session 188 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:42.067083 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:42.638653 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:42.644810 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Create backup started, backup: 9d4da71d-f60b-4222-b391-50f2666f989e volume: 83412f27-5cd2-459c-a509-bffd1456de66. Jul 05 04:40:42.650085 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:40:42Z,data_timestamp=2026-07-05T04:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-899328884',encryption_key_id=None,fail_reason=None,host='np0000004568',id=9d4da71d-f60b-4222-b391-50f2666f989e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9f3c8a595ac432b8b3cad8d2dc58ebd',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f84855f2e86c4503b4af670e811002ce',volume_id=83412f27-5cd2-459c-a509-bffd1456de66) Jul 05 04:40:42.676888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:42.677183 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:42.677556 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:42.686839 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:40:42.705524 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:42.719376 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:40:42.719804 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:40:42.727679 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:40:42.728974 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fecc:3dff', 'fe80::a433:41ff:fe01:9999', 'fe80::30a6:c2ff:fe13:a126', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:40:42.729160 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:40:42.729332 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:40:42.729689 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:43.070204 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.144s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:43.070608 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] <== connect_volume: return (2800ms) {'type': 'block', 'scsi_wwn': '330000000d280495a', 'path': '/dev/sdd'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:43.070897 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:43.092036 np0000004568 sudo[147291]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 05 04:40:43.092827 np0000004568 sudo[147291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:43.234340 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:40:43.235014 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83412f27-5cd2-459c-a509-bffd1456de66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:43.235202 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:43.389162 np0000004568 sudo[147291]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:43.390797 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.320s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:43.433129 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:43.440382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _create_container started, container: volumebackups,backup: 1f15fe19-1d18-471a-b46c-ae2822b343c7. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:40:43.449359 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.214s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:43.450634 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83412f27-5cd2-459c-a509-bffd1456de66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:43.462534 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:43.463101 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:43.463444 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:43.476137 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:43.476137 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66] added Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:43.487850 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:43.488287 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:43.488782 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:43.489146 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:43.581486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] generate_object_name_prefix: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:40:43.586126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] starting backup of volume: fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, volume size: 1073741824, object names prefix volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:40:43.762833 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:44.015271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:44.015435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:44.115928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:44.116256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:44.292050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:44.489952 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:44.503037 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:44.513416 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:44.526122 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:44.526299 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:44.544194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:44.544377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:44.555913 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66, portal: 192.168.40.100,3260] Jul 05 04:40:44.555913 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66, portal: 192.168.40.100,3260] successful. Jul 05 04:40:44.555913 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:44.567231 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:44.580195 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-081e351d-d5a0-4847-adac-e633088256be (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31ae4147-b266-42d1-a060-88918febe16c (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:44.580394 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:44.580685 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:44.580828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:40:44.581598 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] HCTL ('7', '-', '-', 0) found on session 189 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:40:44.581737 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:40:44.593686 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 189 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:40:44.593686 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83412f27-5cd2-459c-a509-bffd1456de66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:40:44.644419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:44.644621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:44.865989 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:45.109805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:45.110003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:45.208230 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:45.208630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:45.380299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:45.598388 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.147s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:45.598388 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (2361ms) {'type': 'block', 'scsi_wwn': '3300000004eb11a38', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:45.598388 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:45.616213 np0000004568 sudo[147370]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:40:45.616828 np0000004568 sudo[147370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:45.622706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:45.622931 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:45.725872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:45.726037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:45.917771 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:45.924678 np0000004568 sudo[147370]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:45.926844 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.330s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:45.937694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _create_container started, container: volumebackups,backup: 9d4da71d-f60b-4222-b391-50f2666f989e. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:40:45.965161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] generate_object_name_prefix: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:40:45.970363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] starting backup of volume: 83412f27-5cd2-459c-a509-bffd1456de66, volume size: 1073741824, object names prefix volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:40:46.163299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:46.163515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:46.178531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:46.264289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:46.264732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:46.420265 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:46.420446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:46.453389 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:46.525971 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:46.526121 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:46.714020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:46.714700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:46.748451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:46.814624 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:46.814801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:46.990870 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:46.993209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:46.993340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:47.099953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:47.099953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:47.241835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:47.243204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:47.301537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:47.349904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:47.350069 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:47.567860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:47.568248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:47.606728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:47.677218 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:47.677416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:47.867804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:47.868197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:47.876796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:47.972024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:47.972024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:48.123758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:48.123946 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:48.160460 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:48.226261 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:48.226857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:48.422981 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:48.427663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:48.427929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:48.532641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:48.532875 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:48.693503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:48.693714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:48.732216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:48.795871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:48.796007 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:48.982380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:48.982666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:49.003782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:49.097447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:49.097447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:49.258646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:49.258935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:49.296030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:49.362980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:49.363093 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:49.547420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:49.547805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:49.567780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:49.651200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:49.651437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:49.820263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:49.820523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:49.840691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:49.939529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:49.939732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:50.097824 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:50.097824 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:50.174139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:50.213912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:50.214111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:50.406281 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:50.443503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:50.443686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:50.550218 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:50.550696 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:50.664953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:50.665077 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:50.733066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:50.772192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:50.773133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:50.963325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:50.979740 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:50.979866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:51.117004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:51.117222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:51.222800 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:51.222985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:51.300853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:51.324165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:51.324371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:51.515116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:51.546749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:51.546749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:51.657674 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:51.658219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:51.786479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:51.786687 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:51.873458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:51.892361 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:51.892640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:52.072905 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:52.113896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:52.114020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:52.213209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:52.213435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:52.311460 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:52.311701 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:52.384979 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:52.411005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:52.411232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:52.596461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:52.636695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:52.636882 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:52.737193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:52.737635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:52.739499 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=208,cinder:UPDATE=69,cinder:INSERT=13 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:40:52.841810 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:52.842019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:52.914896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:52.940354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:52.940510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:53.144538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:53.162595 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:53.162595 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:53.260775 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:53.261020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:53.391123 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:53.391301 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:53.481015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:53.491491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:53.491723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:53.756088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:53.758394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:53.758670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:53.863922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:53.864233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:54.003309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:54.003929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:54.071190 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:54.104008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:54.104149 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:54.272055 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:54.325095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:54.325286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:54.435138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:54.435138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:54.527555 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:54.527690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:54.632143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:54.632349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:54.658314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:54.737758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:54.853189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:54.853597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:54.913439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:54.913675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:54.920660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:54.921825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:54.934051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:40:54.940511 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:40:54.940729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:40:54.950625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:40:54.950793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:40:54.954161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:40:54.954426 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:40:55.021422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:40:55.022155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _write_metadata started, container name: volumebackups, metadata filename: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:40:55.024233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:55.024609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:55.057243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1f15fe19-1d18-471a-b46c-ae2822b343c7",\n "backup_name": "tempest-type-Backup-2025607111",\n "created_at": "2026-07-05 04:40:40+00:00",\n "objects": [\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "fe5e43c0-6db9-4ac8-a612-97e4a7d1c725",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"fe5e43c0-6db9-4ac8-a612-97e4a7d1c725\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"06b29084a0f348b48324a2987b92415c\\", \\"project_id\\": \\"216632b7c396473ca082a2f35841e3d2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:40:39.000000\\", \\"launched_at\\": \\"2026-07-05T04:40:39.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1871518393\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:40:38.000000\\", \\"updated_at\\": \\"2026-07-05T04:40:40.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:40:55.066611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] backup 1f15fe19-1d18-471a-b46c-ae2822b343c7 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:40:55.227980 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:55.259295 np0000004568 sudo[147681]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 05 04:40:55.260061 np0000004568 sudo[147681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:55.275950 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:55.523325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:55.523538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:55.561244 np0000004568 sudo[147681]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:55.563012 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.335s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:55.563687 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000d280495a', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:55.563918 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:55.564383 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:55.564796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:55.574650 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:55.575051 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:55.575051 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:55.575051 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:55.575051 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:55.596203 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:55.596203 np0000004568 cinder-backup[101263]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:55.596203 np0000004568 cinder-backup[101263]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c (non-flash) Jul 05 04:40:55.596203 np0000004568 cinder-backup[101263]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c (non-flash) Jul 05 04:40:55.596203 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:55.596440 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725 (non-flash) Jul 05 04:40:55.596440 np0000004568 cinder-backup[101263]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:55.596440 np0000004568 cinder-backup[101263]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c (non-flash) Jul 05 04:40:55.596440 np0000004568 cinder-backup[101263]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c (non-flash) Jul 05 04:40:55.596440 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:55.596756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25ec1d60-a976-46c4-99de-ac4157607d5c', '191')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:55.596873 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725', '188')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:55.597633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Resulting device map defaultdict(. at 0x77fdedb20ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725'): ({'sdd'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:55.597845 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Removing single pathed devices sdd {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:55.607932 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Flushing IO for device /dev/sdd {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:55.615117 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:55.630294 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:55.630625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:55.658700 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:55.658914 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] SCSI volumes sdd have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:55.659816 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:55.678084 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:55.678415 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:55.689879 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:55.721370 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, portal: 192.168.40.100,3260] Jul 05 04:40:55.721370 np0000004568 cinder-backup[101263]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-fe5e43c0-6db9-4ac8-a612-97e4a7d1c725, portal: 192.168.40.100,3260] successful. Jul 05 04:40:55.721370 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:55.734737 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:55.735053 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.171s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:55.735265 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] <== disconnect_volume: return (171ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:55.844187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:56.088992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:56.089444 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:56.195003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:56.195189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:56.416457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:56.656186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:56.656386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:56.752213 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0ff731cd-4a96-4d4f-9981-e5eae4fdfd39 tempest-ProjectReaderTests33-618491311 None] Create backup finished. backup: 1f15fe19-1d18-471a-b46c-ae2822b343c7. Jul 05 04:40:56.752990 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:56.753242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:56.943250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:57.192090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:57.192555 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:57.293893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:57.294058 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:57.407888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:40:57.526706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:40:57.526848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:40:57.585030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup MD5 for volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:40:57.585202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:40:57.592184 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:40:57.598233 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:40:57.598435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:40:57.602389 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:40:57.602550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:40:57.605579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:40:57.605855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:40:57.660001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:40:57.660818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _write_metadata started, container name: volumebackups, metadata filename: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:40:57.685374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9d4da71d-f60b-4222-b391-50f2666f989e",\n "backup_name": "tempest-type-Backup-899328884",\n "created_at": "2026-07-05 04:40:43+00:00",\n "objects": [\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "83412f27-5cd2-459c-a509-bffd1456de66",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"83412f27-5cd2-459c-a509-bffd1456de66\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f84855f2e86c4503b4af670e811002ce\\", \\"project_id\\": \\"c9f3c8a595ac432b8b3cad8d2dc58ebd\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:40:42.000000\\", \\"launched_at\\": \\"2026-07-05T04:40:42.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1013549196\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:40:41.000000\\", \\"updated_at\\": \\"2026-07-05T04:40:43.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:40:57.689814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] backup 9d4da71d-f60b-4222-b391-50f2666f989e finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:40:57.821730 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:57.845996 np0000004568 sudo[147770]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:40:57.846872 np0000004568 sudo[147770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:40:58.144897 np0000004568 sudo[147770]: pam_unix(sudo:session): session closed for user root Jul 05 04:40:58.146920 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.325s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:40:58.147561 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83412f27-5cd2-459c-a509-bffd1456de66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004eb11a38', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:58.147772 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:58.148258 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:58.148635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83412f27-5cd2-459c-a509-bffd1456de66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:40:58.158486 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:58.158786 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:40:58.158786 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:40:58.158786 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:40:58.158947 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:40:58.177094 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:58.177094 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:58.177254 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66 (non-flash) Jul 05 04:40:58.177254 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:58.177302 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', '189')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:40:58.177443 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66', '189')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:40:58.178180 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fded96fa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:40:58.178380 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:40:58.188356 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:40:58.195945 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:40:58.255014 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:40:58.255227 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:40:58.255987 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:40:58.266910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:40:58.267648 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:40:58.277047 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:58.307279 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66, portal: 192.168.40.100,3260] Jul 05 04:40:58.307279 np0000004568 cinder-backup[101263]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-83412f27-5cd2-459c-a509-bffd1456de66, portal: 192.168.40.100,3260] successful. Jul 05 04:40:58.307279 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:58.321096 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:58.321475 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.173s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:40:58.321751 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (173ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:58.326791 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Create backup started, backup: 9f6690c0-9ad8-4256-a507-e648c9710334 volume: 1846737b-a4e7-45ba-8903-e23e657a8b08. Jul 05 04:40:58.331376 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:40:58Z,data_timestamp=2026-07-05T04:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-70945934',encryption_key_id=None,fail_reason=None,host='np0000004568',id=9f6690c0-9ad8-4256-a507-e648c9710334,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='216632b7c396473ca082a2f35841e3d2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='06b29084a0f348b48324a2987b92415c',volume_id=1846737b-a4e7-45ba-8903-e23e657a8b08) Jul 05 04:40:58.362672 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:40:58.362835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:40:58.363217 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:58.373284 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:40:58.392938 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:40:58.406670 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:40:58.407071 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:40:58.415065 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:40:58.415933 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946'] Jul 05 04:40:58.416129 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:40:58.416281 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:40:58.416545 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:40:58.920781 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:40:58.921215 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1846737b-a4e7-45ba-8903-e23e657a8b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:40:58.921436 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:58.921847 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:58.922055 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1846737b-a4e7-45ba-8903-e23e657a8b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:40:58.932402 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:40:58.932826 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:40:58.933054 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:58.942695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:40:58.942695 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08] added Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:40:58.952815 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:58.953026 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:40:58.953593 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:40:58.953798 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:40:59.367049 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:40:59.380540 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-1c3d9519-b295-4bdc-a273-6bae6800dc6e tempest-ProjectMemberTests33-954956515 None] Create backup finished. backup: 9d4da71d-f60b-4222-b391-50f2666f989e. Jul 05 04:40:59.954871 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:40:59.963859 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:59.973381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:40:59.982777 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 04:40:59.982777 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:40:59.982921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 04:40:59.982921 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:40:59.983059 np0000004568 cinder-backup[101263]: WARNING os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 04:40:59.983059 np0000004568 cinder-backup[101263]: Jul 05 04:41:00.009867 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08, portal: 192.168.40.100,3260] Jul 05 04:41:00.009867 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08, portal: 192.168.40.100,3260] successful. Jul 05 04:41:00.009867 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:00.019837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:00.030318 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:00.030318 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:00.030440 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:00.030440 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:00.030730 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.098s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:00.030876 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:00.031296 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] HCTL ('7', '-', '-', 0) found on session 192 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:00.031416 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:00.045468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Searching for a device in session 192 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:00.045468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1846737b-a4e7-45ba-8903-e23e657a8b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:00.306583 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:41:00.306737 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:41:01.047380 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.125s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:01.047805 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] <== connect_volume: return (2125ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799203', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:01.047983 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:01.066970 np0000004568 sudo[147851]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:41:01.067588 np0000004568 sudo[147851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:01.372474 np0000004568 sudo[147851]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:01.375138 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.326s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:01.383550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _create_container started, container: volumebackups,backup: 9f6690c0-9ad8-4256-a507-e648c9710334. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:01.411327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] generate_object_name_prefix: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:01.417331 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] starting backup of volume: 1846737b-a4e7-45ba-8903-e23e657a8b08, volume size: 1073741824, object names prefix volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:01.607539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:01.850004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:01.850156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:01.950911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:01.950911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:02.150515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:02.276502 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Restore backup started, backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628 volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. Jul 05 04:41:02.290092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:02.290452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:02.291763 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:02.302967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:02.323188 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:02.339585 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:02.339988 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:02.348667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:02.349781 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946'] Jul 05 04:41:02.349955 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:02.350142 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:02.350457 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:02.399840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:02.399988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:02.510343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:02.510557 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:02.550153 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:02.762451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:03.005646 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:03.005869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:03.103750 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:03.104014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:03.298248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:03.368288 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:03.368713 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20a2f164-148b-4920-ae7d-ab9192e0566c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:03.368882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:03.369310 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:03.369507 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20a2f164-148b-4920-ae7d-ab9192e0566c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:03.380352 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:03.380693 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:03.380883 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:03.390354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:03.390354 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c] added Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:03.400910 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:03.401147 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:03.401401 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:03.401579 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:03.543846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:03.544112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:03.671383 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:03.671650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:03.875492 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:04.118610 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:04.118724 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:04.231185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:04.231303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:04.403099 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:04.414835 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:04.428203 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:04.438205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:04.440169 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:04.440169 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:04.440291 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:04.440291 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:04.472893 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c, portal: 192.168.40.100,3260] Jul 05 04:41:04.472893 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c, portal: 192.168.40.100,3260] successful. Jul 05 04:41:04.472893 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:04.484753 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:04.498975 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:04.498975 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:04.498975 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:04.499193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:04.499193 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:04.499193 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:04.499843 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:04.499843 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:04.500344 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] HCTL ('8', '-', '-', 0) found on session 193 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:04.500534 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:04.511743 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Searching for a device in session 193 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:04.511743 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20a2f164-148b-4920-ae7d-ab9192e0566c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:04.676126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:04.676297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:04.777525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:04.777660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:04.963605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:05.211796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:05.212018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:05.312085 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:05.312561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:05.514071 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.144s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:05.514071 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] <== connect_volume: return (2145ms) {'type': 'block', 'scsi_wwn': '330000000ba783fe7', 'path': '/dev/sdc'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:05.515427 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:05.526444 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:05.535600 np0000004568 sudo[147925]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 04:41:05.536261 np0000004568 sudo[147925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:05.766562 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:05.766704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:05.845479 np0000004568 sudo[147925]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:05.847263 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.332s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:05.847698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] starting restore of backup volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628 container: volumebackups, to new volume 20a2f164-148b-4920-ae7d-ab9192e0566c, backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:41:05.847910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] _read_metadata finished. Metadata: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "backup_id": "ee5d63a5-0ba0-47ef-9f6c-648fd8728628", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "backup_name": "tempest-type-Backup-1697003308", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:39:16+00:00", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021": { Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: ], Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_id": "2eaadcae-a194-4958-a064-2dd7277af6b1", Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2eaadcae-a194-4958-a064-2dd7277af6b1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f84855f2e86c4503b4af670e811002ce\", \"project_id\": \"c9f3c8a595ac432b8b3cad8d2dc58ebd\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:39:15.000000\", \"launched_at\": \"2026-07-05T04:39:15.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-110896500\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:39:15.000000\", \"updated_at\": \"2026-07-05T04:39:16.000000\"}}" Jul 05 04:41:05.862305 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:41:05.865644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:41:05.865644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:41:05.865644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:05.865644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] _read_metadata finished. Metadata: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "backup_id": "ee5d63a5-0ba0-47ef-9f6c-648fd8728628", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "backup_name": "tempest-type-Backup-1697003308", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:39:16+00:00", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021": { Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: } Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: ], Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_id": "2eaadcae-a194-4958-a064-2dd7277af6b1", Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2eaadcae-a194-4958-a064-2dd7277af6b1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f84855f2e86c4503b4af670e811002ce\", \"project_id\": \"c9f3c8a595ac432b8b3cad8d2dc58ebd\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:39:15.000000\", \"launched_at\": \"2026-07-05T04:39:15.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-110896500\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:39:15.000000\", \"updated_at\": \"2026-07-05T04:39:16.000000\"}}" Jul 05 04:41:05.879472 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:41:05.884259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] v1 volume backup restore of ee5d63a5-0ba0-47ef-9f6c-648fd8728628 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:41:05.884259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] metadata_object_names = ['volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:41:05.921342 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:05.924992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:05.939132 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:06.069505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:06.278033 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:06.292835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:06.318986 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:06.319102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:06.418082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:06.418252 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:06.442696 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Create backup started, backup: 63c198f1-592f-43da-9266-76029005867a volume: 1e3bf282-877e-4b18-90d3-3abcbd5275f9. Jul 05 04:41:06.448719 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:41:06Z,data_timestamp=2026-07-05T04:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-283494519',encryption_key_id=None,fail_reason=None,host='np0000004568',id=63c198f1-592f-43da-9266-76029005867a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4b9bf69c57274a9ebd9df7b22cb752ff',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c37011ee278f4d08ba97e56c2c2b60b6',volume_id=1e3bf282-877e-4b18-90d3-3abcbd5275f9) Jul 05 04:41:06.642060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_4b9bf69c57274a9ebd9df7b22cb752ff {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:06.642558 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:06.642716 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:06.704506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:06.705450 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:06.711709 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:06.717143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:06.719084 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: 079e1351-604a-44d3-8582-99068dd8351f volume: 1de98c38-4f11-49bc-848b-69539468e9d6. Jul 05 04:41:06.726406 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:06.741290 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:41:06Z,data_timestamp=2026-07-05T04:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1993658600',encryption_key_id=None,fail_reason=None,host='np0000004568',id=079e1351-604a-44d3-8582-99068dd8351f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=1de98c38-4f11-49bc-848b-69539468e9d6) Jul 05 04:41:06.743019 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:06.743346 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:06.743980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:06.750539 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:06.751323 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946'] Jul 05 04:41:06.751471 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:06.751606 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:06.751836 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:06.776129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:06.776349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:06.776695 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:06.787213 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:06.805012 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:06.820933 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:06.821192 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:06.829869 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:06.830628 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946'] Jul 05 04:41:06.830767 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:06.830883 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:06.831115 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:07.074276 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:07.074554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:07.114495 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:07.118303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:07.130931 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:07.184406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:07.184582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:07.255193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:07.255671 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:07.255884 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:07.474696 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:07.475132 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:07.475442 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:07.480517 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:07.494082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:07.515830 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:07.816537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:07.817028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:07.822834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:07.838449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:07.918440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:07.918654 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:08.168509 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:08.182558 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:08.204887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:08.503442 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:08.503803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:08.509318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:08.523853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:08.604101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:08.604260 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:08.860035 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:08.873257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:08.899465 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:09.188833 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:09.189064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:09.194484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:09.208232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:09.293334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:09.293492 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:09.532788 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:09.546193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:09.569327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:09.862071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:09.862472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:09.868212 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:09.885141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:09.963488 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.707s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:09.963488 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:09.971665 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:09.971665 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:09.974305 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:09.974751 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:09.975308 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:09.985464 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:09.985464 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9] added Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:09.996098 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:10.228049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:10.242619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:10.264935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:10.577654 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:10.577832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:10.583497 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:10.599251 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:10.679251 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:10.679386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:10.929576 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:10.946947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:10.975248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:10.999067 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:11.014121 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:11.028057 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.042301 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:11.074144 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9, portal: 192.168.40.100,3260] Jul 05 04:41:11.074144 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9, portal: 192.168.40.100,3260] successful. Jul 05 04:41:11.074144 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:11.085266 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:11.103882 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:11.104333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:11.105309 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] HCTL ('11', '-', '-', 0) found on session 196 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:11.105309 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:11.145652 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Searching for a device in session 196 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:11.146268 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:11.289873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:11.290105 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:11.296747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:11.311985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:11.392499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:11.392623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:11.663266 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:11.678005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:11.701823 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:11.994864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:11.995156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:12.000676 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:12.015120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:12.096786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:12.096949 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:12.149534 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.187s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:12.149766 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] <== connect_volume: return (4894ms) {'type': 'block', 'scsi_wwn': '33000000004396856', 'path': '/dev/sdf'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:12.150119 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:12.160918 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.684s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:12.161673 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:12.173016 np0000004568 sudo[148283]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 05 04:41:12.173527 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:12.173678 np0000004568 sudo[148283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:12.173946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:12.174148 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:12.188676 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:12.188676 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6] added Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:12.199366 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:12.199626 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:12.200049 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:12.200260 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:12.450841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:12.470015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:12.475702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:12.503385 np0000004568 sudo[148283]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:12.504998 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.355s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:12.511292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _create_container started, container: volumebackups,backup: 63c198f1-592f-43da-9266-76029005867a. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:12.812578 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:12.812725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:12.821045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:12.840519 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:12.856014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] generate_object_name_prefix: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:12.863309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] starting backup of volume: 1e3bf282-877e-4b18-90d3-3abcbd5275f9, volume size: 1073741824, object names prefix volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:12.921132 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:12.921328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:13.202853 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:13.208510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restoring object. backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, object name: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021, volume: 20a2f164-148b-4920-ae7d-ab9192e0566c. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:13.214112 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:13.224340 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:13.227234 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:13.238147 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:13.255833 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:13.257752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:13.276202 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] Jul 05 04:41:13.276202 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] successful. Jul 05 04:41:13.276202 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:13.285700 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] HCTL ('12', '-', '-', 0) found on session 197 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:13.298374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:13.323675 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 197 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:13.325887 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:13.393050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] v1 volume backup restore of ee5d63a5-0ba0-47ef-9f6c-648fd8728628 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:41:13.393509 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:41:13.399292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Excluding field 'display_name' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:41:13.399621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Excluding field 'display_description' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:41:13.404057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:41:13.404195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:41:13.404402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] restore ee5d63a5-0ba0-47ef-9f6c-648fd8728628 to 20a2f164-148b-4920-ae7d-ab9192e0566c finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:41:13.404843 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:13.428016 np0000004568 sudo[148346]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 04:41:13.428663 np0000004568 sudo[148346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:13.511845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:13.511845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:13.514554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:13.515220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:13.635929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:13.636059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:13.639291 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:13.639439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:13.758929 np0000004568 sudo[148346]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:13.760839 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.356s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:13.761494 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20a2f164-148b-4920-ae7d-ab9192e0566c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000ba783fe7', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:13.761819 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:13.934979 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:13.945375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:14.178296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:14.178493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:14.186061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:14.186249 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:14.283099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:14.283510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:14.285229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:14.285382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:14.327194 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:14.327384 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (6851ms) {'type': 'block', 'scsi_wwn': '3300000004ea2b1ed', 'path': '/dev/sdg'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:14.327868 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:14.340661 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.577s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:14.342124 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20a2f164-148b-4920-ae7d-ab9192e0566c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:14.354381 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:14.355131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:14.359131 np0000004568 sudo[148381]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 05 04:41:14.359952 np0000004568 sudo[148381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:14.383116 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:14.383438 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:14.383667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '197')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:14.383667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c', '193')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:14.384783 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Resulting device map defaultdict(. at 0x77fded9f8400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c'): ({'sdc'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:14.385043 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Removing single pathed devices sdc {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:14.396773 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Flushing IO for device /dev/sdc {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:14.404618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:14.442666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:14.475402 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:14.475402 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:14.477056 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:14.489654 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:14.490021 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:14.505736 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:14.542880 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c, portal: 192.168.40.100,3260] Jul 05 04:41:14.542880 np0000004568 cinder-backup[101263]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-20a2f164-148b-4920-ae7d-ab9192e0566c, portal: 192.168.40.100,3260] successful. Jul 05 04:41:14.542880 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:14.544706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:14.558438 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:14.558756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.220s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:14.558919 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] <== disconnect_volume: return (797ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:14.576225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:14.577090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:14.648046 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:14.648272 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:14.656857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:41:14.663365 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:41:14.663529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:41:14.668014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:41:14.668253 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:41:14.671306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:41:14.671552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:41:14.678768 np0000004568 sudo[148381]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:14.692384 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.364s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:14.698950 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: 079e1351-604a-44d3-8582-99068dd8351f. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:14.756608 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:41:14.756608 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:41:14.794400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9f6690c0-9ad8-4256-a507-e648c9710334",\n "backup_name": "tempest-type-Backup-70945934",\n "created_at": "2026-07-05 04:40:58+00:00",\n "objects": [\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1846737b-a4e7-45ba-8903-e23e657a8b08",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1846737b-a4e7-45ba-8903-e23e657a8b08\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"06b29084a0f348b48324a2987b92415c\\", \\"project_id\\": \\"216632b7c396473ca082a2f35841e3d2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:40:57.000000\\", \\"launched_at\\": \\"2026-07-05T04:40:57.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1931655507\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:40:57.000000\\", \\"updated_at\\": \\"2026-07-05T04:40:58.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:41:14.802808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] backup 9f6690c0-9ad8-4256-a507-e648c9710334 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:41:14.935312 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:14.950317 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:14.950669 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:14.960429 np0000004568 sudo[148407]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:41:14.961097 np0000004568 sudo[148407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:15.003482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:15.010253 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: 1de98c38-4f11-49bc-848b-69539468e9d6, volume size: 1073741824, object names prefix volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:15.069486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:15.069486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:15.263927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:15.321523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:15.345394 np0000004568 sudo[148407]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:15.347027 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.412s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:15.347547 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1846737b-a4e7-45ba-8903-e23e657a8b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799203', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:15.347760 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:15.348161 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:15.348553 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1846737b-a4e7-45ba-8903-e23e657a8b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:15.358941 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:15.359377 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:15.359377 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:15.359377 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:15.359484 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:15.385134 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08 (non-flash) Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:15.385329 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:15.385441 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '197')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:15.385516 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08', '192')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:15.386664 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Resulting device map defaultdict(. at 0x77fded7ef920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:15.386890 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:15.398778 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:15.407798 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:15.461474 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:15.461676 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:15.462724 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:15.476513 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:15.476513 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:15.492461 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:15.516338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:15.516506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:15.530954 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08, portal: 192.168.40.100,3260] Jul 05 04:41:15.530954 np0000004568 cinder-backup[101263]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-1846737b-a4e7-45ba-8903-e23e657a8b08, portal: 192.168.40.100,3260] successful. Jul 05 04:41:15.530954 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:15.544310 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:15.545666 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.196s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:15.545666 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] <== disconnect_volume: return (197ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:15.571408 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Encryption key ID for volume 20a2f164-148b-4920-ae7d-ab9192e0566c already matches encryption key ID in backup ee5d63a5-0ba0-47ef-9f6c-648fd8728628. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:41:15.591019 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-04df513a-b5b8-4ef0-b951-beecfbf18590 tempest-ProjectMemberTests33-954956515 None] Finished restoring backup ee5d63a5-0ba0-47ef-9f6c-648fd8728628 to volume 20a2f164-148b-4920-ae7d-ab9192e0566c. Jul 05 04:41:15.591809 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:15.591985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:15.630818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:15.630992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:15.697284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:15.697499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:15.877553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:15.942954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:16.121363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:16.121540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:16.191597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:16.191597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:16.236482 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:16.236635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:16.298538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:16.298824 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:16.502934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:16.548683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:16.567730 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-226270d3-95f3-4b68-b848-20ca149c172d tempest-ProjectReaderTests33-618491311 None] Create backup finished. backup: 9f6690c0-9ad8-4256-a507-e648c9710334. Jul 05 04:41:16.711471 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0df519f0-a431-4cea-991e-ee319dc0381b tempest-ProjectReaderTests33-618491311 None] Export record started, backup: 9f6690c0-9ad8-4256-a507-e648c9710334. Jul 05 04:41:16.719208 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0df519f0-a431-4cea-991e-ee319dc0381b tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:16.719453 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-0df519f0-a431-4cea-991e-ee319dc0381b tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:16.719922 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-0df519f0-a431-4cea-991e-ee319dc0381b tempest-ProjectReaderTests33-618491311 None] Export record finished, backup 9f6690c0-9ad8-4256-a507-e648c9710334 exported. Jul 05 04:41:16.771731 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:16.771876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:16.832514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:16.832703 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:16.881218 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:16.881373 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:16.924507 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:16.987885 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:16.988432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:17.154915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:17.232903 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:17.417758 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:17.417969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:17.475424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:17.475617 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:17.545547 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:17.545870 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:17.581906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:17.582076 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:17.728404 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] Delete backup started, backup: 9d4da71d-f60b-4222-b391-50f2666f989e. Jul 05 04:41:17.733099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:17.733540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:17.733948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] delete started, backup: 9d4da71d-f60b-4222-b391-50f2666f989e, container: volumebackups, prefix: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:17.790755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00001', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00002', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00003', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00004', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00005', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00006', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00007', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00008', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00009', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00010', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00011', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00012', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00013', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00014', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00015', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00016', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00017', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00018', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00019', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00020', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00021', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_metadata', 'volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:17.822807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.832948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:17.848585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.852118 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:17.868424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.894138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.921529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.942872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.968582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:17.989934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.016012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.043738 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.085122 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.106297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.108841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:18.109037 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:18.126111 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.139676 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:18.139895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:18.152322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.175216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.209201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.217818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:18.217818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:18.242584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.249146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:18.249146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:18.272047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.279873 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:18.304737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.329129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.355512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.390424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.436310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] deleted object: volume_83412f27-5cd2-459c-a509-bffd1456de66/20260705044045/az_nova_backup_9d4da71d-f60b-4222-b391-50f2666f989e_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.436530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] delete 9d4da71d-f60b-4222-b391-50f2666f989e finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:18.455842 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] Created reservations ['7dbe9c9e-2252-43f2-9714-f56d770df1bf', 'c2c53f9e-43b8-4b68-8e2c-599abcc8f324'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:18.474426 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-a82f0631-a813-45cc-b44d-b089735fb96c tempest-ProjectMemberTests33-954956515 None] Delete backup finished, backup 9d4da71d-f60b-4222-b391-50f2666f989e deleted. Jul 05 04:41:18.593634 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:18.598108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:18.797490 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] Delete backup started, backup: 909393fb-dc4b-4bac-8923-a95706acd8f3. Jul 05 04:41:18.801954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:18.802131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:18.802279 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] delete started, backup: 909393fb-dc4b-4bac-8923-a95706acd8f3, container: volumebackups, prefix: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:18.845752 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00001', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00002', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00003', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00004', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00005', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00006', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00007', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00008', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00009', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00010', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00011', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00012', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00013', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00014', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00015', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00016', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00017', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00018', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00019', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00020', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00021', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_metadata', 'volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:18.849381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:18.849381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:18.856433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:18.856611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:18.872765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.893012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.912060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.934914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.954447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:18.957047 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:18.957212 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:18.985675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:18.985675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:19.012825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.020142 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:19.034036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.054071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.074313 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.093674 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.123474 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.144528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.168924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.189289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.208146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.247819 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.276849 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.300918 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.329322 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.333924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:19.349361 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:19.353472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.381939 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.406124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.430762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_419ef9c5-5549-4cfb-9e2a-2fd29cbf9d54/20260705044025/az_nova_backup_909393fb-dc4b-4bac-8923-a95706acd8f3_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.430762 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] delete 909393fb-dc4b-4bac-8923-a95706acd8f3 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:19.452357 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] Created reservations ['9b843b55-fb3e-44c4-8ee3-7043e0b9dd4b', '8cda0098-bb58-4c0e-9aef-518332379ddc'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:19.477523 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-4fb3c9c0-eded-458a-ae1e-df676d42b011 tempest-ProjectMemberTests33-954956515 None] Delete backup finished, backup 909393fb-dc4b-4bac-8923-a95706acd8f3 deleted. Jul 05 04:41:19.626369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:19.626817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:19.634161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:19.634161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:19.736012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:19.736225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:19.741563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:19.741847 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:19.766394 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Create backup started, backup: 670f8924-78be-429e-b646-c1882dbba28b volume: b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076. Jul 05 04:41:19.770757 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:41:19Z,data_timestamp=2026-07-05T04:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1719165640',encryption_key_id=None,fail_reason=None,host='np0000004568',id=670f8924-78be-429e-b646-c1882dbba28b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='216632b7c396473ca082a2f35841e3d2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='06b29084a0f348b48324a2987b92415c',volume_id=b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076) Jul 05 04:41:19.800042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:19.800258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:19.800632 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:19.812493 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:19.834983 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:19.858282 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:19.858703 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:19.868022 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:19.869086 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fefc:4129', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:41:19.869206 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:19.869329 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:19.869553 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:19.873731 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] Delete backup started, backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628. Jul 05 04:41:19.875166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_c9f3c8a595ac432b8b3cad8d2dc58ebd {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:19.875352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:19.875544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] delete started, backup: ee5d63a5-0ba0-47ef-9f6c-648fd8728628, container: volumebackups, prefix: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:19.939052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] generated object list: ['volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata', 'volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:19.967433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:19.992818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.016532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.052543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.074338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.083533 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:20.085630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:20.092920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.110278 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.135165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.156065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.176680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.194630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.213540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.232755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.250073 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.269857 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.295143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.312001 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.327139 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:20.327275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:20.330061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.357311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.369396 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:20.369623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:20.381830 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:20.382317 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:20.382527 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:20.383015 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:20.383313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:20.386403 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.395974 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:20.396526 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:20.396747 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:20.407388 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:20.407388 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:20.413667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076] added Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:20.417837 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:20.418112 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:20.418353 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:20.418524 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:20.437471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.443016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:20.443170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:20.472348 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] deleted object: volume_2eaadcae-a194-4958-a064-2dd7277af6b1/20260705043919/az_nova_backup_ee5d63a5-0ba0-47ef-9f6c-648fd8728628_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:20.472622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] delete ee5d63a5-0ba0-47ef-9f6c-648fd8728628 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:20.500649 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:20.500873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:20.535013 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:20.554955 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] Created reservations ['121a86b8-75c2-4f3a-baa7-9f2b170d88f2', '131b99ca-0ec0-4f6d-8b48-2e29865f5308'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:20.572005 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9060ae69-1af2-4de1-967a-bee1f66cd791 tempest-ProjectMemberTests33-954956515 None] Delete backup finished, backup ee5d63a5-0ba0-47ef-9f6c-648fd8728628 deleted. Jul 05 04:41:20.827112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:20.829219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:21.084522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:21.084697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:21.087294 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:21.087416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:21.188415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:21.188596 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:21.193362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:21.193559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:21.419414 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:21.434089 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:21.446306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:21.458363 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.458363 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.458363 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:21.458363 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:21.458363 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:21.458617 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.458617 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.458617 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:21.458617 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:21.458617 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:21.481195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:21.493327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:21.500349 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, portal: 192.168.40.100,3260] Jul 05 04:41:21.500349 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, portal: 192.168.40.100,3260] successful. Jul 05 04:41:21.500349 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:21.513842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:21.529837 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:21.530073 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:21.530590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:21.530790 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:21.531695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] HCTL ('7', '-', '-', 0) found on session 198 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:21.531862 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:21.547262 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Searching for a device in session 198 and hctl ['7', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:21.731510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:21.731697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:21.764242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:21.764242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:21.833421 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:21.833778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:21.862706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:21.862887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:22.114699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:22.138487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:22.353186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:22.353485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:22.378858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:22.379097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:22.471302 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:22.471616 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:22.481591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:22.481856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:22.548983 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Searching for a device in session 198 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:22.549156 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:22.549766 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.167s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:22.549935 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] <== connect_volume: return (2167ms) {'type': 'block', 'scsi_wwn': '3300000009b2e3714', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:22.550454 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:22.578988 np0000004568 sudo[148499]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:41:22.579726 np0000004568 sudo[148499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:22.753220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:22.762623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:22.883719 np0000004568 sudo[148499]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:22.885683 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.335s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:22.893954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _create_container started, container: volumebackups,backup: 670f8924-78be-429e-b646-c1882dbba28b. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:22.922472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] generate_object_name_prefix: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:22.927014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] starting backup of volume: b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, volume size: 1073741824, object names prefix volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:23.027713 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.027911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:23.112658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.112904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:23.113466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:23.155145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:23.155420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:23.219744 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:23.220012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:23.365304 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.365723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:23.389418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:23.457486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:23.474422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:23.474678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:23.665156 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.667147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:23.694381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:23.716340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.717210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:23.795594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:23.795594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:23.822410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:23.822717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:23.978987 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:23.979337 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:24.071228 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:24.090162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:24.090428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:24.098780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:24.288030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:24.345165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:24.345296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:24.401364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:24.401641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:24.461688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:24.461846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:24.513481 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:24.513806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:24.707296 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:24.740170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:24.740170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:24.780812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:24.854468 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:24.854639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:24.966345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:24.966516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.021398 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:25.021919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.050887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:25.066163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:25.066343 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:25.133231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:25.133373 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:25.288324 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Create backup started, backup: 696108a1-c928-4e96-93a3-ae372fe41bf5 volume: 0e4325ad-3661-467d-94c9-c83a0280f062. Jul 05 04:41:25.293814 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:41:25Z,data_timestamp=2026-07-05T04:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1553303924',encryption_key_id=None,fail_reason=None,host='np0000004568',id=696108a1-c928-4e96-93a3-ae372fe41bf5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='695062aefa0a461da18287586ea11e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='041d3849eb674966a22f9a6b1fc79de8',volume_id=0e4325ad-3661-467d-94c9-c83a0280f062) Jul 05 04:41:25.311188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:25.311512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.358908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:25.385769 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_695062aefa0a461da18287586ea11e3a {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:25.386120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:25.386633 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:25.397197 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:25.416603 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:25.437888 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:25.438269 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:25.439520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:25.439749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:25.476730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:25.477021 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:25.481663 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fefc:4129', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:41:25.481663 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:25.481663 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:25.481663 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:25.491069 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:25.617554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:25.617823 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.695584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:25.722530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:25.722684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:25.730772 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:25.731087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.832374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:25.832580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:25.944658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:25.945369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:25.964953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:25.983890 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:25.984301 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4325ad-3661-467d-94c9-c83a0280f062', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:25.984508 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:25.984956 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:25.985193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4325ad-3661-467d-94c9-c83a0280f062', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:25.997200 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:25.997584 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:25.997934 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:26.008014 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:26.008014 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062] added Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:26.022684 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:26.023127 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:26.024129 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:26.024592 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:26.050082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:26.050259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:26.063131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:26.220165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:26.220372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:26.245112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:26.305266 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:26.305469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:26.321101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:26.321289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:26.422090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:26.449516 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:26.449739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:26.489928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:26.490194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:26.540643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:26.540643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:26.598815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:26.598992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:26.609431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup MD5 for volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:26.609643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:26.616783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:41:26.625002 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:41:26.625275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:41:26.630859 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:41:26.631175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:41:26.634962 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:41:26.635258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:41:26.694144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:26.698129 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:41:26.698817 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:41:26.724880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "63c198f1-592f-43da-9266-76029005867a",\n "backup_name": "tempest-type-Backup-283494519",\n "created_at": "2026-07-05 04:41:06+00:00",\n "objects": [\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1e3bf282-877e-4b18-90d3-3abcbd5275f9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1e3bf282-877e-4b18-90d3-3abcbd5275f9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c37011ee278f4d08ba97e56c2c2b60b6\\", \\"project_id\\": \\"4b9bf69c57274a9ebd9df7b22cb752ff\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:05.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:05.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1763832269\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:05.000000\\", \\"updated_at\\": \\"2026-07-05T04:41:06.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:41:26.735594 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] backup 63c198f1-592f-43da-9266-76029005867a finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:41:26.858131 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:26.892134 np0000004568 sudo[148582]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 05 04:41:26.893275 np0000004568 sudo[148582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:26.914804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:26.956362 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:26.956621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:27.025371 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:27.036118 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:27.050304 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:27.064102 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:27.064354 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:27.064895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:27.065034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:27.110796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062, portal: 192.168.40.100,3260] Jul 05 04:41:27.110796 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062, portal: 192.168.40.100,3260] successful. Jul 05 04:41:27.110796 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:27.126804 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:27.140532 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:27.140793 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:27.141231 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:27.141431 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:27.142502 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] HCTL ('8', '-', '-', 0) found on session 199 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:27.142958 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:27.156913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:27.157138 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:27.159909 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Searching for a device in session 199 and hctl ['8', '*', '*', 0] yield: None {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:27.268947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:27.269135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:27.280368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:27.360561 np0000004568 sudo[148582]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:27.362361 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.504s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:27.362970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000004396856', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:27.363155 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:27.449500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:27.528619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:27.528770 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:27.629004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:27.629108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:27.687812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:27.687994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:27.798895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:27.799098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:27.814641 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:27.979443 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:28.071384 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:28.071384 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:28.162182 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Searching for a device in session 199 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:28.162182 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4325ad-3661-467d-94c9-c83a0280f062', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:28.162182 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.177s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:28.162182 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] <== connect_volume: return (2177ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799215', 'path': '/dev/sdc'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:28.163151 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:28.179499 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.814s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:28.181092 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e3bf282-877e-4b18-90d3-3abcbd5275f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:28.190547 np0000004568 sudo[148631]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 05 04:41:28.191474 np0000004568 sudo[148631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:28.191725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:28.191944 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:28.196082 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:28.196982 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:28.196982 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:28.196982 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:28.196982 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:28.230977 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:28.231404 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', '199')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:28.231629 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9', '196')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:28.233095 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Resulting device map defaultdict(. at 0x77fdedd0c540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9'): ({'sdf'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:28.233318 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Removing single pathed devices sdf {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:28.247751 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Flushing IO for device /dev/sdf {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:28.255729 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:28.256554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:28.256783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:28.301845 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:28.302070 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:28.303545 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:28.317115 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:28.317439 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:28.319154 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:28.328472 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:28.358870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9, portal: 192.168.40.100,3260] Jul 05 04:41:28.358870 np0000004568 cinder-backup[101263]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-1e3bf282-877e-4b18-90d3-3abcbd5275f9, portal: 192.168.40.100,3260] successful. Jul 05 04:41:28.358870 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:28.373500 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:28.373811 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.197s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:28.373960 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] <== disconnect_volume: return (1011ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:28.375409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:28.375622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:28.503255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:28.503440 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:28.504192 np0000004568 sudo[148631]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:28.506332 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.344s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:28.513658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _create_container started, container: volumebackups,backup: 696108a1-c928-4e96-93a3-ae372fe41bf5. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:28.571906 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:28.572032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:28.578438 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:41:28.583619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:41:28.583860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:41:28.588165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:41:28.588359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:41:28.591280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:41:28.592079 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:41:28.645327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:28.674722 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:41:28.675439 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:41:28.701514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "079e1351-604a-44d3-8582-99068dd8351f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1993658600",\n "created_at": "2026-07-05 04:41:07+00:00",\n "objects": [\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1de98c38-4f11-49bc-848b-69539468e9d6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1de98c38-4f11-49bc-848b-69539468e9d6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:06.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:06.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-582233981\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:05.000000\\", \\"updated_at\\": \\"2026-07-05T04:41:07.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:41:28.707115 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] backup 079e1351-604a-44d3-8582-99068dd8351f finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:41:28.860319 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:28.874563 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] generate_object_name_prefix: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:28.883838 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] starting backup of volume: 0e4325ad-3661-467d-94c9-c83a0280f062, volume size: 1073741824, object names prefix volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:28.889254 np0000004568 sudo[148657]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 05 04:41:28.890149 np0000004568 sudo[148657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:28.920611 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:28.920807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:29.036581 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:29.036798 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:29.063556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:29.224405 np0000004568 sudo[148657]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:29.226232 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.366s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:29.226926 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004ea2b1ed', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:29.227168 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:29.227816 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:29.228256 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:29.234082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:29.240192 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:29.241060 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:29.241060 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:29.241060 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:29.241060 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:29.269723 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:29.269925 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:29.270137 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', '199')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:29.270196 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '197')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:29.271033 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fdedd0f100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6'): ({'sdg'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:29.271228 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdg {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:29.281189 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdg {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:29.288104 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:29.311456 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:29.311675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:29.351103 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:29.351290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdg have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:29.352304 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:29.368117 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:29.368333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:29.383634 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:29.397537 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b693c80e-65f8-40be-ac54-909dddaf0dc3 tempest-ProjectAdminTests39-327125457 None] Create backup finished. backup: 63c198f1-592f-43da-9266-76029005867a. Jul 05 04:41:29.419795 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] Jul 05 04:41:29.419795 np0000004568 cinder-backup[101263]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] successful. Jul 05 04:41:29.419795 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:29.424124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:29.424332 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:29.448199 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:29.448691 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.221s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:29.448691 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (221ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:29.493300 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:29.493584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:29.605223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:29.605399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:29.624359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:29.812183 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:29.870003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:29.870199 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:29.989106 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:29.989251 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:30.033315 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] Delete backup started, backup: 63c198f1-592f-43da-9266-76029005867a. Jul 05 04:41:30.043873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_4b9bf69c57274a9ebd9df7b22cb752ff {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:30.044382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:30.045425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] delete started, backup: 63c198f1-592f-43da-9266-76029005867a, container: volumebackups, prefix: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:30.067737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:30.067932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:30.093197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] generated object list: ['volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00001', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00002', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00003', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00004', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00005', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00006', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00007', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00008', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00009', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00010', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00011', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00012', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00013', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00014', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00015', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00016', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00017', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00018', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00019', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00020', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00021', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_metadata', 'volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:30.118853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.145673 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.166599 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.178294 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:30.178561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:30.218243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.218813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:30.228462 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:30.237113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.255514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.274760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.294009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.311192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.329462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.352420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.376727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.403718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.422238 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:30.432277 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.458304 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.477698 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-5de3f701-3718-489e-a438-8aa143cfa985 tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: 079e1351-604a-44d3-8582-99068dd8351f. Jul 05 04:41:30.481164 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.489733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:30.489877 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:30.501980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.522653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.543289 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.563409 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.584239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.602831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:30.603039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:30.613969 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.648980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] deleted object: volume_1e3bf282-877e-4b18-90d3-3abcbd5275f9/20260705044112/az_nova_backup_63c198f1-592f-43da-9266-76029005867a_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:30.649227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] delete 63c198f1-592f-43da-9266-76029005867a finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:30.667211 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] Created reservations ['ec068760-bff0-41f7-9dcc-403deb3f38c3', '8e56d218-7da9-47a0-b631-064e758e9567'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:30.686722 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-88f8baf5-cce1-48a1-abc8-d081cfba38c0 tempest-ProjectAdminTests39-327125457 None] Delete backup finished, backup 63c198f1-592f-43da-9266-76029005867a deleted. Jul 05 04:41:30.709485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:30.709805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:30.809508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:30.809693 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:30.813175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:30.992951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:31.072454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:31.072702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:31.183698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:31.183865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:31.261080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:31.261490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:31.281777 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Restore backup started, backup: 079e1351-604a-44d3-8582-99068dd8351f volume: 1de98c38-4f11-49bc-848b-69539468e9d6. Jul 05 04:41:31.291380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:31.291604 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:31.291960 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:31.301814 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:31.325492 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:31.345920 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:31.346351 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:31.355835 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:31.357039 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fefc:4129', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:41:31.357226 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:31.357418 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:31.357760 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:31.408036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:31.408258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:31.446034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:31.453690 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:31.655649 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:31.705219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:31.705844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:31.809659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:31.809913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:31.925248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:31.925436 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:32.010196 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:32.036550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:32.036826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:32.224805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:32.308727 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:32.309071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:32.364210 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:32.364787 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:32.365033 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:32.365611 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:32.365899 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:32.376418 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:32.376860 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:32.377092 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:32.389607 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:32.389607 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6] added Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:32.400223 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:32.400504 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:32.400923 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:32.401174 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:32.411753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:32.411957 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:32.499717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:32.499864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:32.611835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:32.640140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:32.640341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:32.842376 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:32.883772 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:32.883772 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:32.989887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:32.990075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:33.104880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:33.105028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:33.186030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:33.226652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:33.227048 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:33.401788 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:33.406779 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:33.416824 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:33.427504 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:33.428612 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:33.428753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:33.439577 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.439577 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.439577 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:33.439577 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:33.439577 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:33.439777 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.439777 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.439777 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:33.439777 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:33.439777 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:33.474851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] Jul 05 04:41:33.474851 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] successful. Jul 05 04:41:33.474851 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:33.484946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:33.498330 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:33.498553 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:33.498783 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:33.498919 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:33.499619 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] HCTL ('11', '-', '-', 0) found on session 200 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:33.499748 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:33.510663 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 200 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:33.510935 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:33.534431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:33.534613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:33.721226 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:33.763655 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:33.763864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:33.863263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:33.863988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:33.969455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:33.969626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:34.060078 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:34.065016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:34.065222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:34.243050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:34.308860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:34.309035 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:34.416126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:34.416621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:34.492920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:34.493677 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:34.515839 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:34.516979 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799211', 'path': '/dev/sdf'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:34.518335 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:34.545987 np0000004568 sudo[148842]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 05 04:41:34.547761 np0000004568 sudo[148842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:34.610335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:34.614017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:34.614171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:34.786866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:34.862075 np0000004568 sudo[148842]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:34.863844 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.346s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:34.864286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] starting restore of backup volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f container: volumebackups, to existing volume 1de98c38-4f11-49bc-848b-69539468e9d6, backup: 079e1351-604a-44d3-8582-99068dd8351f. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:41:34.866613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] _read_metadata started, container name: volumebackups, metadata filename: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:41:34.875049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:34.875324 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] _read_metadata finished. Metadata: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "backup_id": "079e1351-604a-44d3-8582-99068dd8351f", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-1993658600", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:41:07+00:00", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021": { Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: ], Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_id": "1de98c38-4f11-49bc-848b-69539468e9d6", Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1de98c38-4f11-49bc-848b-69539468e9d6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"418a6fadaf1d44969df596e7da41fde2\", \"project_id\": \"8d8f47c439224301aab1a833cea9c24f\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:41:06.000000\", \"launched_at\": \"2026-07-05T04:41:06.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-582233981\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:41:05.000000\", \"updated_at\": \"2026-07-05T04:41:07.000000\"}}" Jul 05 04:41:34.883354 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:41:34.888372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:41:34.888372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] _read_metadata started, container name: volumebackups, metadata filename: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] _read_metadata finished. Metadata: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "backup_id": "079e1351-604a-44d3-8582-99068dd8351f", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-1993658600", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:41:07+00:00", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021": { Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: } Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: ], Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_id": "1de98c38-4f11-49bc-848b-69539468e9d6", Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1de98c38-4f11-49bc-848b-69539468e9d6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"418a6fadaf1d44969df596e7da41fde2\", \"project_id\": \"8d8f47c439224301aab1a833cea9c24f\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:41:06.000000\", \"launched_at\": \"2026-07-05T04:41:06.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-582233981\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:41:05.000000\", \"updated_at\": \"2026-07-05T04:41:07.000000\"}}" Jul 05 04:41:34.899064 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:41:34.904099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 079e1351-604a-44d3-8582-99068dd8351f started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:41:34.904099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] metadata_object_names = ['volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:41:34.935118 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:34.938672 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:34.951012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:34.978679 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:34.978854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:35.059650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:35.059650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:35.084617 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:35.178248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:35.178454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:35.418431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:35.418876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:35.428338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:35.452130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:35.471983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:35.496071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup MD5 for volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:35.496071 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:35.501332 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:41:35.506871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:41:35.507031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:41:35.510579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:41:35.510755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:41:35.513471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:41:35.513704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:41:35.578794 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:41:35.579519 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:41:35.600268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "670f8924-78be-429e-b646-c1882dbba28b",\n "backup_name": "tempest-type-Backup-1719165640",\n "created_at": "2026-07-05 04:41:20+00:00",\n "objects": [\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"06b29084a0f348b48324a2987b92415c\\", \\"project_id\\": \\"216632b7c396473ca082a2f35841e3d2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:19.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:19.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-768599094\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:19.000000\\", \\"updated_at\\": \\"2026-07-05T04:41:20.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:41:35.604972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] backup 670f8924-78be-429e-b646-c1882dbba28b finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:41:35.729536 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:35.752980 np0000004568 sudo[148868]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:41:35.753757 np0000004568 sudo[148868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:35.759063 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:35.762223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:35.930855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:35.949548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:36.006110 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:36.007172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:36.080197 np0000004568 sudo[148868]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:36.082032 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.353s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:36.082685 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000009b2e3714', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:36.082924 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:36.083426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:36.083906 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:36.096554 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:36.097469 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:36.097469 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:36.097469 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:36.097469 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:36.157117 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076 (non-flash) Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:36.157359 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:36.157565 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '200')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:36.157687 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076', '198')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:36.158992 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Resulting device map defaultdict(. at 0x77fded9bbc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:36.158992 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:36.171706 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:36.181884 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:36.322264 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:36.322544 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:36.322807 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:36.323771 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:36.326630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:36.334500 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:36.334838 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:36.346801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:36.347905 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:36.392796 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, portal: 192.168.40.100,3260] Jul 05 04:41:36.392796 np0000004568 cinder-backup[101263]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076, portal: 192.168.40.100,3260] successful. Jul 05 04:41:36.392796 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:36.408921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:36.408921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:36.408921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] <== disconnect_volume: return (325ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:36.746783 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:36.747280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:36.752850 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:36.775879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:36.855739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:36.855912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:37.173169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:37.175920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:37.193374 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:37.430580 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f83b6cf9-b5bb-4c3c-a3b3-cfe3be5ee530 tempest-ProjectReaderTests33-618491311 None] Create backup finished. backup: 670f8924-78be-429e-b646-c1882dbba28b. Jul 05 04:41:37.586618 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:37.601991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:37.612112 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:37.612225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:37.720100 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:37.720287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:38.044096 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:38.065256 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:38.083756 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:38.439665 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:38.439808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:38.445599 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:38.469695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:38.550236 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:38.550236 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:38.870368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:38.890206 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:38.908968 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:39.263958 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:39.264367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:39.267517 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:39.284825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:39.372801 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] Delete backup started, backup: 670f8924-78be-429e-b646-c1882dbba28b. Jul 05 04:41:39.379528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:39.379873 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:39.380101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] delete started, backup: 670f8924-78be-429e-b646-c1882dbba28b, container: volumebackups, prefix: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:39.387082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:39.387257 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:39.428339 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:39.434400 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] generated object list: ['volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00001', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00002', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00003', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00004', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00005', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00006', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00007', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00008', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00009', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00010', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00011', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00012', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00013', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00014', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00015', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00016', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00017', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00018', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00019', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00020', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00021', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_metadata', 'volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:39.454653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.499709 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.523670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.696385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.711709 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:39.726058 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:39.728425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.744980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.749970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:39.765113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.787415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.808948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.826461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.847486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.863940 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.881221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.896527 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.950204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:39.966635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.106702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.108005 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:40.108150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:40.117063 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:40.133559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.136619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:40.154791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.175196 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.193301 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.210915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.234656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] deleted object: volume_b1c07e19-3c22-4bc6-bfb5-e7e9b88ee076/20260705044122/az_nova_backup_670f8924-78be-429e-b646-c1882dbba28b_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.234893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] delete 670f8924-78be-429e-b646-c1882dbba28b finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:40.237162 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:40.237349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:40.278888 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] Created reservations ['6115d7c4-a572-4e75-90ca-42dce4eed782', '07c02fae-5197-422a-896d-f692c489394b'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:40.295214 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-05a9c1ae-d123-412b-9055-51e77aac0c1b tempest-ProjectReaderTests33-618491311 None] Delete backup finished, backup 670f8924-78be-429e-b646-c1882dbba28b deleted. Jul 05 04:41:40.541727 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] Delete backup started, backup: 9f6690c0-9ad8-4256-a507-e648c9710334. Jul 05 04:41:40.545011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:40.545425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:40.545599 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] delete started, backup: 9f6690c0-9ad8-4256-a507-e648c9710334, container: volumebackups, prefix: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:40.558286 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:40.576976 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:40.601172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] generated object list: ['volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00001', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00002', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00003', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00004', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00005', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00006', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00007', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00008', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00009', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00010', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00011', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00012', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00013', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00014', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00015', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00016', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00017', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00018', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00019', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00020', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00021', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_metadata', 'volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:40.603213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:40.634955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.662861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.686561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.712347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.739073 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.785222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.803907 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.823883 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:40.982700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.008711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:41.008880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:41.018402 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:41.022423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:41.026032 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.040253 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:41.048451 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.066471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.085681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.104060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.119415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:41.119556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:41.122366 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.142913 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.166768 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.187200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.210590 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.230245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.258243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.286647 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.350841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_1846737b-a4e7-45ba-8903-e23e657a8b08/20260705044101/az_nova_backup_9f6690c0-9ad8-4256-a507-e648c9710334_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.351051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] delete 9f6690c0-9ad8-4256-a507-e648c9710334 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:41.371177 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] Created reservations ['99914e99-b56a-477c-b7ad-daaabb86c7ae', '261dabfc-1d08-47cb-b56c-1b9794f1c7d8'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:41.390717 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3d5fa28c-3c15-4c74-a379-208881cdd951 tempest-ProjectReaderTests33-618491311 None] Delete backup finished, backup 9f6690c0-9ad8-4256-a507-e648c9710334 deleted. Jul 05 04:41:41.536030 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] Delete backup started, backup: 1f15fe19-1d18-471a-b46c-ae2822b343c7. Jul 05 04:41:41.536717 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_216632b7c396473ca082a2f35841e3d2 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:41.536815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:41.536952 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] delete started, backup: 1f15fe19-1d18-471a-b46c-ae2822b343c7, container: volumebackups, prefix: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:41.538815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:41.548833 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:41.571854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:41.588172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] generated object list: ['volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00001', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00002', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00003', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00004', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00005', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00006', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00007', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00008', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00009', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00010', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00011', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00012', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00013', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00014', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00015', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00016', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00017', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00018', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00019', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00020', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00021', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_metadata', 'volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:41.610304 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.637714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.661915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.681750 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.700773 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.719384 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.780411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.789760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:41.790980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:41.811896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:41.840163 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.009075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:42.009288 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:42.010270 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.049611 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:42.056363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:42.063631 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.071579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:42.083891 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.104883 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.122934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.144410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.164492 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.186629 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.215024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.274739 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.285273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:42.296171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.469431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.477887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:42.489041 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.492430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:42.520224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] deleted object: volume_fe5e43c0-6db9-4ac8-a612-97e4a7d1c725/20260705044043/az_nova_backup_1f15fe19-1d18-471a-b46c-ae2822b343c7_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:42.520462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] delete 1f15fe19-1d18-471a-b46c-ae2822b343c7 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:42.534390 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] Created reservations ['752b3d5d-fdb1-43b6-9ded-86d66d878b5e', '5bba6eb9-f0fb-4c54-8e17-bfe153f6ae3f'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:42.538141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:42.538291 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:42.549484 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-d2516a95-c786-43f9-a18e-222c4cb986d8 tempest-ProjectReaderTests33-618491311 None] Delete backup finished, backup 1f15fe19-1d18-471a-b46c-ae2822b343c7 deleted. Jul 05 04:41:42.656684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:42.656860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:42.906268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:42.910351 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:42.925352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:43.025416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:43.025580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:43.087237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup MD5 for volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:43.087486 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:43.101346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:41:43.157701 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:41:43.157894 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:41:43.166283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:41:43.166483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:41:43.171014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:41:43.171316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:41:43.339268 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:41:43.339920 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _write_metadata started, container name: volumebackups, metadata filename: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:41:43.343926 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:43.365895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:43.373306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "696108a1-c928-4e96-93a3-ae372fe41bf5",\n "backup_name": "tempest-type-Backup-1553303924",\n "created_at": "2026-07-05 04:41:25+00:00",\n "objects": [\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0e4325ad-3661-467d-94c9-c83a0280f062",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0e4325ad-3661-467d-94c9-c83a0280f062\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"041d3849eb674966a22f9a6b1fc79de8\\", \\"project_id\\": \\"695062aefa0a461da18287586ea11e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:24.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:24.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-328629612\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:24.000000\\", \\"updated_at\\": \\"2026-07-05T04:41:25.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:41:43.378540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] backup 696108a1-c928-4e96-93a3-ae372fe41bf5 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:41:43.504585 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:43.525008 np0000004568 sudo[148918]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 05 04:41:43.525832 np0000004568 sudo[148918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:43.760054 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, object name: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021, volume: 1de98c38-4f11-49bc-848b-69539468e9d6. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:41:43.777761 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:41:43.823896 np0000004568 sudo[148918]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:43.825816 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.321s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:43.826376 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4325ad-3661-467d-94c9-c83a0280f062', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799215', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:43.826613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:43.827067 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:43.827433 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4325ad-3661-467d-94c9-c83a0280f062', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:43.838383 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:43.839061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:43.839061 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:43.839061 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:43.839061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:43.876030 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:43.876030 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:43.876030 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:43.876030 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:43.876030 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:43.876297 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:43.876297 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:43.876297 np0000004568 cinder-backup[101263]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062 (non-flash) Jul 05 04:41:43.876297 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:43.876297 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:43.876454 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '200')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:43.876454 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062', '199')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:43.877324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Resulting device map defaultdict(. at 0x77fded96e200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062'): ({'sdc'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:43.877525 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Removing single pathed devices sdc {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:43.890499 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Flushing IO for device /dev/sdc {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:43.900665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:43.975666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 079e1351-604a-44d3-8582-99068dd8351f finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:41:43.975935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:41:43.978606 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:43.978606 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] SCSI volumes sdc have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:43.978606 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:43.986512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_name' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:41:43.986512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_description' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:41:43.991839 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:43.991839 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:43.994489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:41:43.994489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:41:43.994489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] restore 079e1351-604a-44d3-8582-99068dd8351f to 1de98c38-4f11-49bc-848b-69539468e9d6 finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:41:44.211231 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:44.219235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.232092 np0000004568 sudo[148945]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 05 04:41:44.232796 np0000004568 sudo[148945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:44.259695 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062, portal: 192.168.40.100,3260] Jul 05 04:41:44.259695 np0000004568 cinder-backup[101263]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-0e4325ad-3661-467d-94c9-c83a0280f062, portal: 192.168.40.100,3260] successful. Jul 05 04:41:44.259695 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.272158 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.272688 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:44.272896 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] <== disconnect_volume: return (446ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:44.542217 np0000004568 sudo[148945]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:44.544138 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.333s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:44.544715 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799211', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:44.544921 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:44.545418 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:44.545861 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1de98c38-4f11-49bc-848b-69539468e9d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:41:44.558238 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:44.558603 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:41:44.558603 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:41:44.558603 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:41:44.558848 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:41:44.582341 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:44.582341 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:44.582341 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:44.582341 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:44.582626 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:44.582626 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:44.582626 np0000004568 cinder-backup[101263]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6 (non-flash) Jul 05 04:41:44.582626 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:44.582854 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '200')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:41:44.583054 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6', '200')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:41:44.584135 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fded9b9580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6'): ({'sdf'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:41:44.584412 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdf {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:41:44.595303 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdf {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:41:44.604306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:41:44.652418 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:41:44.652616 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdf have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:41:44.653754 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:41:44.663458 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:41:44.663717 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:41:44.672633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.697613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] Jul 05 04:41:44.697613 np0000004568 cinder-backup[101263]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-1de98c38-4f11-49bc-848b-69539468e9d6, portal: 192.168.40.100,3260] successful. Jul 05 04:41:44.697613 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.709232 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:44.709232 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:44.709471 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (164ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:45.296836 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-84f6e6e4-d61f-45f4-88b1-b49e6826ee85 tempest-ProjectReaderTests39-632132924 None] Create backup finished. backup: 696108a1-c928-4e96-93a3-ae372fe41bf5. Jul 05 04:41:45.723870 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Encryption key ID for volume 1de98c38-4f11-49bc-848b-69539468e9d6 already matches encryption key ID in backup 079e1351-604a-44d3-8582-99068dd8351f. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:41:45.746868 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-43c41cfc-7248-43b7-8bcf-79efcb253c42 tempest-VolumesBackupsTest-1691274772 None] Finished restoring backup 079e1351-604a-44d3-8582-99068dd8351f to volume 1de98c38-4f11-49bc-848b-69539468e9d6. Jul 05 04:41:45.750991 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] Delete backup started, backup: 696108a1-c928-4e96-93a3-ae372fe41bf5. Jul 05 04:41:45.757157 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_695062aefa0a461da18287586ea11e3a {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:45.757352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:45.757540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] delete started, backup: 696108a1-c928-4e96-93a3-ae372fe41bf5, container: volumebackups, prefix: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:45.802694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] generated object list: ['volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00001', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00002', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00003', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00004', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00005', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00006', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00007', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00008', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00009', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00010', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00011', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00012', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00013', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00014', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00015', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00016', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00017', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00018', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00019', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00020', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00021', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_metadata', 'volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:45.823221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.842589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.862402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.880962 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.900704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.921155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.940365 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.959948 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:45.978911 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.000591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.025411 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.045458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.064254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.092395 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.115311 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.136346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.154452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.177695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.195558 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.220024 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.240484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.264195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.287340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] deleted object: volume_0e4325ad-3661-467d-94c9-c83a0280f062/20260705044128/az_nova_backup_696108a1-c928-4e96-93a3-ae372fe41bf5_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.287589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] delete 696108a1-c928-4e96-93a3-ae372fe41bf5 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:46.325279 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:46.336765 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] Created reservations ['978c40d2-0f3a-4e2a-a7ff-57c52adceacb', 'b5dc86f4-1a2f-42d9-9ca8-b3b5dbf35293'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:46.355594 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-c59ec666-1479-4fb6-8b36-b5298767eea4 tempest-ProjectReaderTests39-632132924 None] Delete backup finished, backup 696108a1-c928-4e96-93a3-ae372fe41bf5 deleted. Jul 05 04:41:46.719661 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: 079e1351-604a-44d3-8582-99068dd8351f. Jul 05 04:41:46.725067 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:46.725334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:46.725334 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] delete started, backup: 079e1351-604a-44d3-8582-99068dd8351f, container: volumebackups, prefix: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:41:46.760506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata', 'volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:41:46.783399 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.804480 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.825405 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.860169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.881603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.897065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.921840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.943198 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.961393 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.979161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:46.997328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.020023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.038328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.056732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.076406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.094714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.112616 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.133813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.155136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.179532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.202631 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.227448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.247431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_1de98c38-4f11-49bc-848b-69539468e9d6/20260705044115/az_nova_backup_079e1351-604a-44d3-8582-99068dd8351f_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:41:47.247667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] delete 079e1351-604a-44d3-8582-99068dd8351f finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:41:47.280003 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:47.291991 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] Created reservations ['d96233e6-6919-4572-8b0f-4ecee42b6a5d', '170f4073-d361-4423-a3bf-b67826085487'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:41:47.304899 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-693a4812-42d9-4bd5-bab6-2489bae21f1e tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup 079e1351-604a-44d3-8582-99068dd8351f deleted. Jul 05 04:41:49.115270 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. Jul 05 04:41:49.120254 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:41:49Z,data_timestamp=2026-07-05T04:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-95294067',encryption_key_id=None,fail_reason=None,host='np0000004568',id=9e5c907d-e48c-42ad-9ac6-8a6a231963f2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=2515dd97-c087-4af2-9015-abe16a4cd2b2) Jul 05 04:41:49.149749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:41:49.149973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:41:49.150330 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:49.161229 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:41:49.190825 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:49.203753 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:41:49.204053 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:41:49.212654 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:41:49.213687 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fefc:4129', 'fe80::a082:41ff:fe79:e97d', 'fe80::f816:3eff:fee9:72be', 'fe80::78e0:c0ff:feb8:1cc3'] Jul 05 04:41:49.213827 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:41:49.213959 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:41:49.214194 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (63ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:49.720876 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:41:49.721298 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:41:49.721475 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:49.721985 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:49.722191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:41:49.735882 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:41:49.736436 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:41:49.736732 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:49.748891 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:41:49.748891 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2] added Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:41:49.763666 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:49.763890 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:41:49.764434 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:41:49.764724 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:41:50.766116 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:41:50.776496 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:50.786494 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:50.797674 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.797674 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.797674 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:50.797810 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.797810 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.797810 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:50.833283 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:41:50.833283 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:41:50.833283 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:50.846026 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:41:50.859883 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.859883 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.859883 np0000004568 cinder-backup[101263]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:41:50.859883 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:41:50.860105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.860105 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:41:50.860105 np0000004568 cinder-backup[101263]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:41:50.860105 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:41:50.860463 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:50.860645 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:41:50.861367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] HCTL ('7', '-', '-', 0) found on session 201 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:41:50.861525 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:41:50.874653 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 201 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:41:50.874910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:41:51.877325 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.155s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:41:51.877750 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2155ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799220', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:41:51.877942 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:41:51.895232 np0000004568 sudo[149080]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:41:51.895890 np0000004568 sudo[149080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:41:52.184250 np0000004568 sudo[149080]: pam_unix(sudo:session): session closed for user root Jul 05 04:41:52.186406 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.308s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:41:52.223542 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:41:52.229889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:41:52.258284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:41:52.263923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2, volume size: 1073741824, object names prefix volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:41:52.440449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:52.687496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:52.687733 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:52.787878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:52.788043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:52.789665 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=304,cinder:UPDATE=100,cinder:INSERT=19 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:41:52.967543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:53.240499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:53.240671 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:53.361016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:53.361227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:53.540476 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:53.789757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:53.789757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:53.895737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:53.895964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:54.098991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:54.365074 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:54.365295 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:54.464796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:54.464953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:54.645333 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:54.880264 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:54.880449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:54.977036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:54.977292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:55.187915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:55.436091 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:55.436271 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:55.534387 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:55.534619 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:55.719598 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:55.962418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:55.962697 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:56.062008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:56.062205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:56.250479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:56.499858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:56.499858 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:56.600078 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:56.600255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:56.787318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:57.028745 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:57.028908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:57.130401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:57.130711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:57.335950 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:57.589247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:57.589441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:57.694938 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:57.695149 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:57.902545 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:58.145591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:58.145818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:58.259469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:58.259602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:58.446539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:58.697549 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:58.697780 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:58.802712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:58.802900 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:58.976507 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:59.251655 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:59.251870 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:59.357904 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:59.358141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:41:59.528886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:41:59.775869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:41:59.776063 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:41:59.883869 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:41:59.885201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:00.135654 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:00.309681 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:42:00.309819 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:42:00.389922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:00.390102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:00.506220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:00.506220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:00.690832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:00.940193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:00.940429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:01.054337 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:01.054493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:01.236718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:01.487973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:01.488124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:01.591588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:01.591804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:01.777897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:02.019515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:02.019767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:02.128316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:02.128663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:02.307447 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:02.560855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:02.561029 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:02.664726 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:02.665004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:02.848508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:03.087416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:03.087640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:03.185341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:03.185556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:03.298241 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:03.430228 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:03.430228 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:03.494591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:03.494591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:03.500657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:42:03.504860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:42:03.505017 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:42:03.511583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:42:03.511583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:42:03.511583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:42:03.511583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:42:03.564553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:42:03.565336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:42:03.587887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9e5c907d-e48c-42ad-9ac6-8a6a231963f2",\n "backup_name": "tempest-VolumesBackupsTest-Backup-95294067",\n "created_at": "2026-07-05 04:41:49+00:00",\n "objects": [\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2515dd97-c087-4af2-9015-abe16a4cd2b2",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2515dd97-c087-4af2-9015-abe16a4cd2b2\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:48.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-833168619\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:48.000000\\", \\"updated_at\\": \\"2026-07-05T04:41:49.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:42:03.593880 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] backup 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:42:03.722644 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:03.741811 np0000004568 sudo[149127]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:42:03.742383 np0000004568 sudo[149127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:04.038977 np0000004568 sudo[149127]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:04.041028 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.318s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:04.041730 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799220', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:04.041939 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:04.042548 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:04.042938 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:04.052581 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:04.052958 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:42:04.052958 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:42:04.052958 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:42:04.053060 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:42:04.070888 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:42:04.070888 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:42:04.070888 np0000004568 cinder-backup[101263]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:04.070888 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:04.071083 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:42:04.071083 np0000004568 cinder-backup[101263]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3 (non-flash) Jul 05 04:42:04.071083 np0000004568 cinder-backup[101263]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:04.071083 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:04.071247 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-801c6e55-525b-4766-b0d5-16fad7f776e3', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '201')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:42:04.071398 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '201')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:42:04.072324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fded38bd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:42:04.072539 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:42:04.082885 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:42:04.091345 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:42:04.155238 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:42:04.155473 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:42:04.156605 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:42:04.168121 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:42:04.168404 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:42:04.177932 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:04.211084 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:42:04.211084 np0000004568 cinder-backup[101263]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:42:04.211084 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:04.223187 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:04.223497 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:04.223676 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (181ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:05.242904 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f52ea0b6-68cd-48a0-ae68-27e99ec5ad66 tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2. Jul 05 04:42:05.522190 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: 7e2c1022-d65c-4373-9d35-a715cd979d59 volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. Jul 05 04:42:05.527391 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:42:05Z,data_timestamp=2026-07-05T04:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-953883381',encryption_key_id=None,fail_reason=None,host='np0000004568',id=7e2c1022-d65c-4373-9d35-a715cd979d59,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(9e5c907d-e48c-42ad-9ac6-8a6a231963f2),parent_id='9e5c907d-e48c-42ad-9ac6-8a6a231963f2',project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=2515dd97-c087-4af2-9015-abe16a4cd2b2) Jul 05 04:42:05.552046 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:42:05.552699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:42:05.553101 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:05.563455 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:42:05.585581 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:05.595836 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:42:05.596182 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:42:05.605941 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:42:05.606167 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fee9:72be', 'fe80::78e0:c0ff:feb8:1cc3'] Jul 05 04:42:05.606413 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:42:05.606651 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:42:05.607028 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:06.112242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:42:06.112242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:06.112242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:06.112242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:06.112242 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:42:06.123971 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:06.123971 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:06.123971 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:06.135440 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:42:06.135440 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2] added Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:42:06.147756 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:42:07.149095 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:42:07.160447 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:07.171224 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: WARNING os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 04:42:07.182482 np0000004568 cinder-backup[101263]: Jul 05 04:42:07.220120 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:42:07.220120 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:42:07.220120 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:07.229458 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] HCTL ('7', '-', '-', 0) found on session 202 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:42:07.240426 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:42:07.253910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 202 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:42:07.253910 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:42:08.255480 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.143s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:08.258584 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2144ms) {'type': 'block', 'scsi_wwn': '33000000063e1f156', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:08.258584 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:08.275156 np0000004568 sudo[149263]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:42:08.275811 np0000004568 sudo[149263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:08.563053 np0000004568 sudo[149263]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:08.565217 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.308s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:08.602660 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:42:08.607487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:42:08.639090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:42:08.650231 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: 7e2c1022-d65c-4373-9d35-a715cd979d59. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:42:08.679806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:42:08.689373 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2, volume size: 1073741824, object names prefix volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:42:12.750318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:42:12.756390 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:42:12.756588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:42:12.760043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:42:12.760181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:42:12.762657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:42:12.762867 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:42:12.813462 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:42:12.814169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:42:12.834902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7e2c1022-d65c-4373-9d35-a715cd979d59",\n "backup_name": "tempest-VolumesBackupsTest-Backup-953883381",\n "created_at": "2026-07-05 04:42:05+00:00",\n "objects": [],\n "parent_id": "9e5c907d-e48c-42ad-9ac6-8a6a231963f2",\n "version": "1.0.0",\n "volume_id": "2515dd97-c087-4af2-9015-abe16a4cd2b2",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2515dd97-c087-4af2-9015-abe16a4cd2b2\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:41:48.000000\\", \\"launched_at\\": \\"2026-07-05T04:41:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-833168619\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:41:48.000000\\", \\"updated_at\\": \\"2026-07-05T04:42:05.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:42:12.839132 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] backup 7e2c1022-d65c-4373-9d35-a715cd979d59 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:42:12.959357 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:12.976722 np0000004568 sudo[149289]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:42:12.977391 np0000004568 sudo[149289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:13.297044 np0000004568 sudo[149289]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:13.299142 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.340s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:13.300207 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000063e1f156', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:13.300207 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:13.300635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:13.301065 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:13.311942 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:13.312241 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:42:13.312241 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:42:13.312241 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:42:13.312355 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:42:13.337613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:13.337613 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:13.337613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:13.337613 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:13.337613 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '202')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:42:13.337904 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '202')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:42:13.338528 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fded9fa840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:42:13.338734 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:42:13.348851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:42:13.357979 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:42:13.414350 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:42:13.414350 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:42:13.415848 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:42:13.427090 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:42:13.427251 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:42:13.437821 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:13.466443 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:42:13.466443 np0000004568 cinder-backup[101263]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:42:13.466443 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:13.476271 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:13.476633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.176s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:13.476942 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (177ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:14.501920 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-2d363831-f845-4cf5-99c4-039bbf8e32b2 tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: 7e2c1022-d65c-4373-9d35-a715cd979d59. Jul 05 04:42:14.753005 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Restore backup started, backup: 7e2c1022-d65c-4373-9d35-a715cd979d59 volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. Jul 05 04:42:14.766053 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:42:14.766538 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:42:14.766877 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:14.776328 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:42:14.794392 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:14.807302 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:42:14.807586 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:42:14.814976 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:42:14.816003 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fee9:72be', 'fe80::78e0:c0ff:feb8:1cc3', 'fe80::bc2c:3bff:fea4:d6c3'] Jul 05 04:42:14.816141 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:42:14.816290 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:42:14.816530 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:15.823399 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:42:15.823926 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:15.824144 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:15.824763 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:15.825063 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:42:15.836367 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:15.836800 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:15.837065 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:15.847398 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:42:15.847398 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2] added Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:15.858093 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:15.858360 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:42:15.858586 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:42:15.858790 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:42:16.860319 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:42:16.872523 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:16.883795 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:16.893253 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 04:42:16.893253 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:16.893253 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 04:42:16.893253 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:16.893441 np0000004568 cinder-backup[101263]: WARNING os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 04:42:16.893441 np0000004568 cinder-backup[101263]: Jul 05 04:42:16.925108 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:42:16.925108 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:42:16.925108 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:16.936368 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:16.947759 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:16.947759 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:16.947919 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:16.947919 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:16.948320 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:16.948429 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:42:16.948802 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] HCTL ('7', '-', '-', 0) found on session 203 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:42:16.948946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:42:16.963375 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 203 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:42:16.963375 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:42:17.967317 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.143s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:17.967685 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2143ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799220', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:17.967868 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:17.992726 np0000004568 sudo[149496]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:42:17.993550 np0000004568 sudo[149496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:18.296960 np0000004568 sudo[149496]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:18.299265 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.331s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:18.299879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] starting restore of backup volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59 container: volumebackups, to existing volume 2515dd97-c087-4af2-9015-abe16a4cd2b2, backup: 7e2c1022-d65c-4373-9d35-a715cd979d59. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:42:18.300127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata finished. Metadata: { Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "backup_id": "7e2c1022-d65c-4373-9d35-a715cd979d59", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-953883381", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:42:05+00:00", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "objects": [], Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "parent_id": "9e5c907d-e48c-42ad-9ac6-8a6a231963f2", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "volume_id": "2515dd97-c087-4af2-9015-abe16a4cd2b2", Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2515dd97-c087-4af2-9015-abe16a4cd2b2\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"418a6fadaf1d44969df596e7da41fde2\", \"project_id\": \"8d8f47c439224301aab1a833cea9c24f\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:41:48.000000\", \"launched_at\": \"2026-07-05T04:41:48.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-833168619\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:41:48.000000\", \"updated_at\": \"2026-07-05T04:42:05.000000\"}}" Jul 05 04:42:18.329730 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:42:18.330134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:42:18.365629 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:42:18.370006 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata finished. Metadata: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "backup_id": "9e5c907d-e48c-42ad-9ac6-8a6a231963f2", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-95294067", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:41:49+00:00", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021": { Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: } Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: ], Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_id": "2515dd97-c087-4af2-9015-abe16a4cd2b2", Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2515dd97-c087-4af2-9015-abe16a4cd2b2\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"418a6fadaf1d44969df596e7da41fde2\", \"project_id\": \"8d8f47c439224301aab1a833cea9c24f\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:41:48.000000\", \"launched_at\": \"2026-07-05T04:41:48.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-833168619\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:41:48.000000\", \"updated_at\": \"2026-07-05T04:41:49.000000\"}}" Jul 05 04:42:18.382719 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:42:18.387328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:42:18.387328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] metadata_object_names = ['volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:42:18.418429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_metadata', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:42:18.422141 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:18.435397 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:18.840992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:18.857806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:19.280084 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:19.293813 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:19.691347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:19.709030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:20.109600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:20.125649 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:20.524763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:20.545330 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:20.966844 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:20.985460 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:21.365797 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:21.385741 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:21.774278 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:21.787413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:22.175074 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:22.189220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:22.572081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:22.591871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:22.989258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:23.005220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:23.380879 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:23.395204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:23.776240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:23.796093 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:24.168048 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:24.183203 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:24.567524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:24.584932 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:25.033219 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:25.051730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:25.473980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:25.488653 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:25.883383 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:25.901448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:26.279810 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:26.293160 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:26.685993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restoring object. backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, object name: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021, volume: 2515dd97-c087-4af2-9015-abe16a4cd2b2. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:42:26.708625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:42:26.896087 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:42:26.896375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:42:26.904194 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_name' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:42:26.904520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_description' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:42:26.912970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:42:26.913218 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:42:26.913452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _read_metadata finished. Metadata: { Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "backup_id": "7e2c1022-d65c-4373-9d35-a715cd979d59", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "backup_name": "tempest-VolumesBackupsTest-Backup-953883381", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:42:05+00:00", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "objects": [], Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "parent_id": "9e5c907d-e48c-42ad-9ac6-8a6a231963f2", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "volume_id": "2515dd97-c087-4af2-9015-abe16a4cd2b2", Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2515dd97-c087-4af2-9015-abe16a4cd2b2\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"418a6fadaf1d44969df596e7da41fde2\", \"project_id\": \"8d8f47c439224301aab1a833cea9c24f\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:41:48.000000\", \"launched_at\": \"2026-07-05T04:41:48.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-833168619\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:41:48.000000\", \"updated_at\": \"2026-07-05T04:42:05.000000\"}}" Jul 05 04:42:26.932159 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:42:26.932658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 7e2c1022-d65c-4373-9d35-a715cd979d59 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:42:26.932658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] metadata_object_names = []. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:42:26.976493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:42:26.976763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] v1 volume backup restore of 7e2c1022-d65c-4373-9d35-a715cd979d59 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:42:26.977018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:42:26.985667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_name' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:42:26.986153 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Excluding field 'display_description' {{(pid=101263) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 05 04:42:26.990284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:42:26.990489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:42:26.990831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] restore 7e2c1022-d65c-4373-9d35-a715cd979d59 to 2515dd97-c087-4af2-9015-abe16a4cd2b2 finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:42:27.218155 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:27.238845 np0000004568 sudo[149955]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:42:27.239648 np0000004568 sudo[149955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:27.544543 np0000004568 sudo[149955]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:27.547473 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.329s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:27.547876 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799220', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:27.548075 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:27.548498 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:27.548950 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2515dd97-c087-4af2-9015-abe16a4cd2b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:27.561442 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:27.562091 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:42:27.562091 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:42:27.562091 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:42:27.562446 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:27.591074 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2 (non-flash) Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:27.591246 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:27.591434 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '207')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:42:27.591639 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2', '203')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:42:27.592593 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fded7ec040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:42:27.592836 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:42:27.603814 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:42:27.611559 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:42:27.655770 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:42:27.655997 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:42:27.657680 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:42:27.670293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:42:27.670525 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:42:27.680170 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:27.708080 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] Jul 05 04:42:27.708080 np0000004568 cinder-backup[101263]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-2515dd97-c087-4af2-9015-abe16a4cd2b2, portal: 192.168.40.100,3260] successful. Jul 05 04:42:27.708080 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:27.723056 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:27.723419 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.175s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:27.723618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (175ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:28.738972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Encryption key ID for volume 2515dd97-c087-4af2-9015-abe16a4cd2b2 already matches encryption key ID in backup 7e2c1022-d65c-4373-9d35-a715cd979d59. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:42:28.751136 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8a9918a1-bf65-48e9-940c-2d9c2e45003b tempest-VolumesBackupsTest-1691274772 None] Finished restoring backup 7e2c1022-d65c-4373-9d35-a715cd979d59 to volume 2515dd97-c087-4af2-9015-abe16a4cd2b2. Jul 05 04:42:29.165381 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: 7e2c1022-d65c-4373-9d35-a715cd979d59. Jul 05 04:42:29.171963 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:42:29.172125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:42:29.172290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] delete started, backup: 7e2c1022-d65c-4373-9d35-a715cd979d59, container: volumebackups, prefix: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:42:29.204368 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:42:29.223763 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:29.242176 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044208/az_nova_backup_7e2c1022-d65c-4373-9d35-a715cd979d59_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:29.242778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] delete 7e2c1022-d65c-4373-9d35-a715cd979d59 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:42:29.279266 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:42:29.292783 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] Created reservations ['56824d9e-8d91-4702-b5a7-cf2df5edb514', '08905696-c9cd-4ef6-8a88-08f56091773a'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:42:29.321906 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-31e56ad9-199a-4b13-909d-96e64266ed2f tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup 7e2c1022-d65c-4373-9d35-a715cd979d59 deleted. Jul 05 04:42:30.234113 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2. Jul 05 04:42:30.240664 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:42:30.240895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:42:30.241082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] delete started, backup: 9e5c907d-e48c-42ad-9ac6-8a6a231963f2, container: volumebackups, prefix: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:42:30.284089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_metadata', 'volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:42:30.301347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.324540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.341272 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.359848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.377297 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.394887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.413263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.432050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.451846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.469434 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.487777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.506197 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.524345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.542870 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.566893 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.587252 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.604267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.620363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.640964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.662127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.685583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.710416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.730178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_2515dd97-c087-4af2-9015-abe16a4cd2b2/20260705044152/az_nova_backup_9e5c907d-e48c-42ad-9ac6-8a6a231963f2_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:42:30.730415 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] delete 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:42:30.763924 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:42:30.776603 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] Created reservations ['b1405934-411c-4f60-bef6-321d8151df12', 'a1a4f9e4-1706-4b19-9c64-117256523405'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:42:30.790281 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-9a577f4d-dc52-46d9-ba4a-fb02fb4f2145 tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup 9e5c907d-e48c-42ad-9ac6-8a6a231963f2 deleted. Jul 05 04:42:32.850434 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba volume: fe924c32-aae9-4fd7-9648-fce40834574e. Jul 05 04:42:32.855160 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:42:32Z,data_timestamp=2026-07-05T04:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-212342893',encryption_key_id=None,fail_reason=None,host='np0000004568',id=c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=fe924c32-aae9-4fd7-9648-fce40834574e) Jul 05 04:42:32.879639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:42:32.879639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:42:32.879639 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:32.888850 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:42:32.907810 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:32.923298 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:42:32.923739 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:42:32.931259 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:42:32.932352 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fee9:72be', 'fe80::78e0:c0ff:feb8:1cc3', 'fe80::f816:3eff:fe67:a56d', 'fe80::bc2c:3bff:fea4:d6c3', 'fe80::f816:3eff:fe6b:3543', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:42:32.932633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:42:32.932832 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:42:32.933170 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:33.437646 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:42:33.437646 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:33.437646 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:33.722725 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.285s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:33.722725 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:42:33.734827 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:33.734827 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:33.734827 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:33.744206 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:42:33.744206 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e] added Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0201(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:42:33.755131 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:42:34.755993 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:42:34.768185 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:34.778747 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.792130 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:34.831726 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] Jul 05 04:42:34.831726 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] successful. Jul 05 04:42:34.831726 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:34.842093 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4624bc37-f46e-4d71-b2fa-3e466bc56f26 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d150dc38-61ae-49ce-be9c-c2575deabe5f (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:34.857424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:42:34.858012 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] HCTL ('13', '-', '-', 0) found on session 210 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:42:34.858012 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:42:34.868853 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 210 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:42:34.868853 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:42:35.871593 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.150s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:35.874026 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2434ms) {'type': 'block', 'scsi_wwn': '330000000b80571bb', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:35.874026 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:35.891176 np0000004568 sudo[150329]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:42:35.891796 np0000004568 sudo[150329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:36.175336 np0000004568 sudo[150329]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:36.179592 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.304s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:36.215374 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:42:36.223316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:42:36.248463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:42:36.252167 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: fe924c32-aae9-4fd7-9648-fce40834574e, volume size: 1073741824, object names prefix volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:42:36.452689 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:37.152816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:37.152816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:37.388328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:37.388328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:37.560306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:37.808298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:37.808298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:37.911104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:37.911104 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:38.104715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:38.369211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:38.369703 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:38.484150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00003: a35891500449df17e893f84bd88472fb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:38.484280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:38.691579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:38.937711 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:38.937962 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:39.055959 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:39.055959 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:39.249459 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:39.516239 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:39.516684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:39.614751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:39.614939 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:39.799429 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:40.055269 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:40.055414 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:40.152833 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:40.153019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:40.356208 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:40.606082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:40.606364 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:40.712651 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:40.712831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:40.921543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:41.193466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:41.193627 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:41.321031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:41.321031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:41.518137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:41.777040 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:41.777481 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:41.875430 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:41.875612 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:42.085303 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:42.325077 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:42.325227 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:42.427159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:42.427346 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:42.632490 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:42.871979 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:42.872370 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:42.970463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:42.970677 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:43.148273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:43.386503 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:43.386705 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:43.484206 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:43.484356 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:43.672851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:43.913266 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:43.913841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:44.027726 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:44.027908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:44.210861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:44.454905 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:44.455028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:44.553201 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:44.553318 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:44.727164 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:44.980221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:44.980591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:45.085990 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:45.086282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:45.267483 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:45.511559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:45.511698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:45.610287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:45.610551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:45.828700 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:46.083784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:46.084074 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:46.189478 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:46.189759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:46.369786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:46.619014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:46.619173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:46.720811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:46.720998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:46.904062 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:47.147101 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:47.147457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:47.245663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:47.245793 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:47.428632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:47.665187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:47.665402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:47.766663 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:47.766889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:47.851601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:42:47.966452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:42:47.966692 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:42:48.024514 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:42:48.024678 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:42:48.031744 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:42:48.037907 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:42:48.038099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:42:48.041985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:42:48.042114 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:42:48.045327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 04:42:48.045575 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:42:48.096472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:42:48.097130 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:42:48.118804 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba",\n "backup_name": "tempest-VolumesBackupsTest-Backup-212342893",\n "created_at": "2026-07-05 04:42:33+00:00",\n "objects": [\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "fe924c32-aae9-4fd7-9648-fce40834574e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"fe924c32-aae9-4fd7-9648-fce40834574e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:42:32.000000\\", \\"launched_at\\": \\"2026-07-05T04:42:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1378559268\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:42:32.000000\\", \\"updated_at\\": \\"2026-07-05T04:42:33.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"e01f3214-b74f-47dd-a99b-2ae9aad3efec\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:42:48.123200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] backup c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:42:48.244617 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:42:48.264181 np0000004568 sudo[150471]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:42:48.264833 np0000004568 sudo[150471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:42:48.553245 np0000004568 sudo[150471]: pam_unix(sudo:session): session closed for user root Jul 05 04:42:48.555470 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.311s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:42:48.556131 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000b80571bb', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:42:48.556357 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:42:48.556851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:42:48.557217 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:42:48.567667 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:48.568021 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:42:48.568021 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:42:48.568021 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:42:48.568078 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:42:48.588750 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:48.588750 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:48.588750 np0000004568 cinder-backup[101263]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:42:48.588750 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:42:48.588972 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:48.588972 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:42:48.588972 np0000004568 cinder-backup[101263]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:42:48.588972 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:42:48.589050 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '210')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:42:48.589193 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '210')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:42:48.590035 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fded7ef9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:42:48.590246 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:42:48.600535 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:42:48.608479 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:42:48.641993 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:42:48.642154 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:42:48.643125 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:42:48.653185 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:42:48.653468 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:42:48.663152 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:48.698456 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] Jul 05 04:42:48.698456 np0000004568 cinder-backup[101263]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] successful. Jul 05 04:42:48.698456 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:48.710069 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:42:48.710470 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.154s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:42:48.710828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (153ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:42:49.729631 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-f319e74e-b58e-48bd-a350-321b17db5b8e tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba. Jul 05 04:42:59.728693 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=133,cinder:UPDATE=33,cinder:INSERT=4 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:43:00.314054 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:43:00.314341 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:43:06.584207 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Create backup started, backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6 volume: 6f68cd36-998a-455d-89f9-531d2e0c3751. Jul 05 04:43:06.588775 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:43:06Z,data_timestamp=2026-07-05T04:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-backup-1527792399',encryption_key_id=None,fail_reason=None,host='np0000004568',id=08164d0c-a4e9-413f-833b-8b0bab5f51c6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f7b59b49c01547eea71bf55ecda7b781',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4f455d6b938543448b1aaaf50f692f2f',volume_id=6f68cd36-998a-455d-89f9-531d2e0c3751) Jul 05 04:43:06.614116 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_f7b59b49c01547eea71bf55ecda7b781 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:43:06.614353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:43:06.614788 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:06.625697 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:43:06.649308 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:06.662325 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:43:06.662590 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:43:06.672259 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:43:06.673551 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe67:a56d', 'fe80::bc2c:3bff:fea4:d6c3', 'fe80::f816:3eff:fe6b:3543', 'fe80::a082:41ff:fe79:e97d', 'fe80::3429:c9ff:fe5f:495c'] Jul 05 04:43:06.673551 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:43:06.673551 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:43:06.674340 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:07.178802 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:43:07.179202 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f68cd36-998a-455d-89f9-531d2e0c3751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:07.179376 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:07.179896 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:07.180082 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f68cd36-998a-455d-89f9-531d2e0c3751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:43:07.190629 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:07.190976 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:07.191169 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:07.201389 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:43:07.201389 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751] added Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:07.211819 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:07.212008 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:43:07.212298 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:43:07.212468 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:43:08.214320 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:43:08.225530 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:08.237338 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.250896 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.251307 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:08.287786 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751, portal: 192.168.40.100,3260] Jul 05 04:43:08.287786 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751, portal: 192.168.40.100,3260] successful. Jul 05 04:43:08.287786 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:08.298018 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 (non-flash) Jul 05 04:43:08.310466 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20d9e2d2-f455-453f-87b1-f48fd28ea83f (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 (non-flash) Jul 05 04:43:08.310683 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:08.310970 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:08.311100 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:43:08.311908 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] HCTL ('13', '-', '-', 0) found on session 215 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:43:08.312036 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:43:08.322858 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Searching for a device in session 215 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:43:08.323083 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f68cd36-998a-455d-89f9-531d2e0c3751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:43:09.326295 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.146s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:09.326667 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] <== connect_volume: return (2146ms) {'type': 'block', 'scsi_wwn': '330000000e8e5ff55', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:09.326864 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:09.343828 np0000004568 sudo[151127]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:43:09.344394 np0000004568 sudo[151127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:43:09.638090 np0000004568 sudo[151127]: pam_unix(sudo:session): session closed for user root Jul 05 04:43:09.640145 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.313s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:43:09.678611 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:43:09.686729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _create_container started, container: volumebackups,backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:43:09.806307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] generate_object_name_prefix: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:43:09.810805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] starting backup of volume: 6f68cd36-998a-455d-89f9-531d2e0c3751, volume size: 1073741824, object names prefix volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:43:09.997656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:10.686147 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:10.686505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:10.917143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:10.917347 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:11.091420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:11.327539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:11.327742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:11.431306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:11.431501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:11.618246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:11.920407 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:11.921150 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:12.036327 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003: a35891500449df17e893f84bd88472fb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:12.036532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:12.227023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:12.471670 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:12.471832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:12.568883 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:12.569091 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:12.769097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:13.023773 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:13.024148 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:13.144212 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:13.144367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:13.329871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:13.588293 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:13.588433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:13.682988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:13.683142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:13.894300 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:14.148046 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:14.148431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:14.245309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:14.245463 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:14.416704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:14.660618 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:14.660856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:14.757892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:14.758056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:14.936751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:15.174967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:15.175339 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:15.274377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:15.274377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:15.452542 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:15.692125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:15.692125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:15.788876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:15.788876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:15.972930 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:16.214597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:16.215121 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:16.337856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:16.337856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:16.525379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:16.767034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:16.767189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:16.871349 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:16.871583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:17.046341 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:17.287173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:17.287640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:17.387972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:17.388171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:17.568282 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:17.812623 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:17.812796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:17.922640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:17.922640 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:18.121553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:18.372626 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:18.373049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:18.470896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:18.471146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:18.651502 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:18.892528 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:18.892736 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:18.999531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:18.999749 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:19.186800 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:19.427593 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:19.427991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:19.523306 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:19.523441 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:19.700427 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:19.964195 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:19.964345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:20.060792 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:20.061061 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:20.251353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:20.493119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:20.493543 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:20.589584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:20.589759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:20.761774 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:21.006559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:21.006559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:21.108947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:21.108947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:21.199328 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:21.315420 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:21.315614 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:21.374020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup MD5 for volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:21.374176 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:21.383298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:43:21.389035 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:43:21.389225 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:43:21.393302 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:43:21.393454 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:43:21.396805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 04:43:21.397055 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:43:21.450221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:43:21.450221 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _write_metadata started, container name: volumebackups, metadata filename: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:43:21.469642 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "08164d0c-a4e9-413f-833b-8b0bab5f51c6",\n "backup_name": "tempest-TestVolumeBackupRestore-backup-1527792399",\n "created_at": "2026-07-05 04:43:07+00:00",\n "objects": [\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6f68cd36-998a-455d-89f9-531d2e0c3751",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6f68cd36-998a-455d-89f9-531d2e0c3751\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"4f455d6b938543448b1aaaf50f692f2f\\", \\"project_id\\": \\"f7b59b49c01547eea71bf55ecda7b781\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:43:05.000000\\", \\"launched_at\\": \\"2026-07-05T04:43:06.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-TestVolumeBackupRestore-volume-2076437183\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:43:05.000000\\", \\"updated_at\\": \\"2026-07-05T04:43:07.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"e01f3214-b74f-47dd-a99b-2ae9aad3efec\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:43:21.475170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] backup 08164d0c-a4e9-413f-833b-8b0bab5f51c6 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:43:21.595896 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:21.613109 np0000004568 sudo[151414]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:43:21.613765 np0000004568 sudo[151414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:43:21.890363 np0000004568 sudo[151414]: pam_unix(sudo:session): session closed for user root Jul 05 04:43:21.892600 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.297s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:43:21.893313 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f68cd36-998a-455d-89f9-531d2e0c3751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e8e5ff55', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:21.893595 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:24.757334 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.864s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:24.757786 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f68cd36-998a-455d-89f9-531d2e0c3751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:24.768780 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:24.769324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:43:24.769324 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:43:24.769324 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:43:24.769324 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:24.796946 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751 (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:24.797186 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:24.797374 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9', '219')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:43:24.797449 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751', '215')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:43:24.798436 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Resulting device map defaultdict(. at 0x77fe0bf2e3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:43:24.798662 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:43:24.810614 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:43:24.818652 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:43:24.855029 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:43:24.855298 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:43:24.856665 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:43:24.866512 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:43:24.866834 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:43:24.877213 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:24.905469 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751, portal: 192.168.40.100,3260] Jul 05 04:43:24.905469 np0000004568 cinder-backup[101263]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-6f68cd36-998a-455d-89f9-531d2e0c3751, portal: 192.168.40.100,3260] successful. Jul 05 04:43:24.905469 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:24.920870 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:24.921106 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:24.921271 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] <== disconnect_volume: return (3027ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:25.945853 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-98e56143-8020-4a4d-960e-ed8df52544ce tempest-TestVolumeBackupRestore-1269666036 None] Create backup finished. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6. Jul 05 04:43:27.205751 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Restore backup started, backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6 volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. Jul 05 04:43:27.219204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_f7b59b49c01547eea71bf55ecda7b781 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:43:27.219947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:43:27.220555 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:27.235348 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:43:27.298288 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:27.312459 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-dcbd7ef9-084c-4f85-9ec1-06689f4072ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:43:27.314754 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:43:27.314996 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:43:27.324422 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:43:27.326828 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe67:a56d', 'fe80::bc2c:3bff:fea4:d6c3', 'fe80::f816:3eff:fe77:d8c1', 'fe80::3429:c9ff:fe5f:495c', 'fe80::f816:3eff:fe6b:3543', 'fe80::a082:41ff:fe79:e97d'] Jul 05 04:43:27.326828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:43:27.326828 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:43:27.326828 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:28.333011 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:43:28.333429 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:28.333635 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:28.334069 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:28.334284 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:43:28.344594 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:28.344932 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:28.345127 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:28.355918 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:43:28.355918 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01] added Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:28.366281 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:28.366526 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:43:28.366883 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:43:28.367092 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:43:29.368070 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:43:29.378206 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:29.388152 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.399899 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.400250 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:29.438371 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, portal: 192.168.40.100,3260] Jul 05 04:43:29.438371 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, portal: 192.168.40.100,3260] successful. Jul 05 04:43:29.438371 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:29.448442 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:43:29.465219 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7631e4c1-1310-4be6-a7d8-27f792201076 (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24399c61-b027-4257-8298-a02625ca53d9 (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:43:29.465503 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:29.465726 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:29.465841 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:43:29.466612 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] HCTL ('13', '-', '-', 0) found on session 220 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:43:29.466746 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:43:29.479778 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Searching for a device in session 220 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:43:29.480002 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:43:30.483656 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:30.484142 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] <== connect_volume: return (2150ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799253', 'path': '/dev/sdh'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:30.484386 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:30.501583 np0000004568 sudo[151888]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 05 04:43:30.502167 np0000004568 sudo[151888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:43:30.804030 np0000004568 sudo[151888]: pam_unix(sudo:session): session closed for user root Jul 05 04:43:30.806020 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.321s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:43:30.806479 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] starting restore of backup volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6 container: volumebackups, to new volume 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 05 04:43:30.806693 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] _read_metadata started, container name: volumebackups, metadata filename: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] _read_metadata finished. Metadata: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "backup_id": "08164d0c-a4e9-413f-833b-8b0bab5f51c6", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "backup_name": "tempest-TestVolumeBackupRestore-backup-1527792399", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:43:07+00:00", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021": { Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: ], Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_id": "6f68cd36-998a-455d-89f9-531d2e0c3751", Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6f68cd36-998a-455d-89f9-531d2e0c3751\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"4f455d6b938543448b1aaaf50f692f2f\", \"project_id\": \"f7b59b49c01547eea71bf55ecda7b781\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:43:05.000000\", \"launched_at\": \"2026-07-05T04:43:06.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-2076437183\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:43:05.000000\", \"updated_at\": \"2026-07-05T04:43:07.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"e01f3214-b74f-47dd-a99b-2ae9aad3efec\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 04:43:30.822561 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:43:30.825437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Restoring backup version 1.0.0 {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 05 04:43:30.825437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] _read_metadata started, container name: volumebackups, metadata filename: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] _read_metadata finished. Metadata: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "backup_description": null, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "backup_id": "08164d0c-a4e9-413f-833b-8b0bab5f51c6", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "backup_name": "tempest-TestVolumeBackupRestore-backup-1527792399", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "created_at": "2026-07-05 04:43:07+00:00", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "objects": [ Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 0 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 52428800 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "a35891500449df17e893f84bd88472fb", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 104857600 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 157286400 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 209715200 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 262144000 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 314572800 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 367001600 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 419430400 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 471859200 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 524288000 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 576716800 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 629145600 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 681574400 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 734003200 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 786432000 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 838860800 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 891289600 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 943718400 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 52428800, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 996147200 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021": { Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "compression": "zlib", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "length": 25165824, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "offset": 1048576000 Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: } Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: ], Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "parent_id": null, Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "version": "1.0.0", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_id": "6f68cd36-998a-455d-89f9-531d2e0c3751", Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6f68cd36-998a-455d-89f9-531d2e0c3751\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"4f455d6b938543448b1aaaf50f692f2f\", \"project_id\": \"f7b59b49c01547eea71bf55ecda7b781\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004568@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-05T04:43:05.000000\", \"launched_at\": \"2026-07-05T04:43:06.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-2076437183\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"716a9331-c074-495d-ae3e-a2fc71ed6efa\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f45ab009-e882-4d79-8665-6d232490a731\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-05T04:43:05.000000\", \"updated_at\": \"2026-07-05T04:43:07.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"e01f3214-b74f-47dd-a99b-2ae9aad3efec\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 05 04:43:30.836767 np0000004568 cinder-backup[101263]: }. {{(pid=101263) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 05 04:43:30.839983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] v1 volume backup restore of 08164d0c-a4e9-413f-833b-8b0bab5f51c6 started. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 05 04:43:30.839983 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] metadata_object_names = ['volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021']. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 05 04:43:30.875690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] generated object list: ['volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:43:30.881449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:30.998508 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:31.410255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:31.425091 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:31.761484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:31.779865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:32.116938 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:32.131914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:32.454220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:32.469044 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:32.796724 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:32.813899 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:33.141756 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:33.154755 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:33.476753 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:33.490580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:33.817564 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:33.833489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:34.161587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:34.176151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:34.500696 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:34.516354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:34.838416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:34.851014 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:35.170586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:35.184520 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:35.500216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:35.513553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:35.835042 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:35.848754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:36.178579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:36.192487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:36.511178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:36.523751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:36.850784 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:36.865375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:37.189476 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:37.205737 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:37.531244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:37.544878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:37.874834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restoring object. backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, object name: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021, volume: 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 05 04:43:37.888809 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] decompressing data using zlib algorithm {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 05 04:43:38.040209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] v1 volume backup restore of 08164d0c-a4e9-413f-833b-8b0bab5f51c6 finished. {{(pid=101263) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 05 04:43:38.040457 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Restoring volume base metadata {{(pid=101263) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 05 04:43:38.049924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] No metadata of type 'volume-metadata' to restore {{(pid=101263) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 05 04:43:38.050077 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Restoring volume glance metadata {{(pid=101263) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 05 04:43:38.122751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] restore 08164d0c-a4e9-413f-833b-8b0bab5f51c6 to 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 finished. {{(pid=101263) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 05 04:43:38.131851 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:38.149527 np0000004568 sudo[152041]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 05 04:43:38.150125 np0000004568 sudo[152041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:43:38.433646 np0000004568 sudo[152041]: pam_unix(sudo:session): session closed for user root Jul 05 04:43:38.435961 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.304s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:43:38.436756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799253', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:38.437051 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:40.695059 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.258s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:40.695522 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:43:40.705978 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:40.706387 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:43:40.706387 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:43:40.706387 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:43:40.706758 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('-m', 'session'): stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f (non-flash) Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f (non-flash) Jul 05 04:43:40.728414 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsi session list stdout=tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f (non-flash) Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f (non-flash) Jul 05 04:43:40.728639 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:40.728935 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6378e4-d1c1-43df-a1f0-ba90fbfceb0f', '222')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:43:40.729248 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '220')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:43:40.730387 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Resulting device map defaultdict(. at 0x77fe0c1ba480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01'): ({'sdh'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:43:40.730680 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Removing single pathed devices sdh {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:43:40.740907 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Flushing IO for device /dev/sdh {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:43:40.749294 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:43:40.786142 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:43:40.786333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] SCSI volumes sdh have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:43:40.787756 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:43:40.798115 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:43:40.798302 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:43:40.808686 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:40.841916 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, portal: 192.168.40.100,3260] Jul 05 04:43:40.841916 np0000004568 cinder-backup[101263]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01, portal: 192.168.40.100,3260] successful. Jul 05 04:43:40.841916 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:40.855170 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:40.855443 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.161s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:40.855633 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] <== disconnect_volume: return (2418ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:41.867173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.manager [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Encryption key ID for volume 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 already matches encryption key ID in backup 08164d0c-a4e9-413f-833b-8b0bab5f51c6. {{(pid=101263) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 05 04:43:41.883405 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-b28c5f20-a670-4a9d-a1ab-4ba68d224ac0 tempest-TestVolumeBackupRestore-1269666036 None] Finished restoring backup 08164d0c-a4e9-413f-833b-8b0bab5f51c6 to volume 069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01. Jul 05 04:43:51.881600 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=88,cinder:UPDATE=12,cinder:INSERT=15 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:43:53.528386 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: 07c2bfce-38ea-4dca-85ff-2f504b736058 volume: fe924c32-aae9-4fd7-9648-fce40834574e. Jul 05 04:43:53.532228 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:43:53Z,data_timestamp=2026-07-05T04:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-401799486',encryption_key_id=None,fail_reason=None,host='np0000004568',id=07c2bfce-38ea-4dca-85ff-2f504b736058,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba),parent_id='c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba',project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=fe924c32-aae9-4fd7-9648-fce40834574e) Jul 05 04:43:53.559254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:43:53.559991 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:43:53.559991 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:53.569264 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:43:53.587481 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:53.602188 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:43:53.602507 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:43:53.610395 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:43:53.611531 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe67:a56d', 'fe80::bc2c:3bff:fea4:d6c3'] Jul 05 04:43:53.611721 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:43:53.611879 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:43:53.612187 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:54.117184 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:43:54.117747 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:43:54.117983 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:54.118537 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:54.118851 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:43:54.129061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:43:54.129424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:43:54.129728 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:54.139432 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:43:54.139432 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e] added Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:43:54.149312 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:54.149585 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:43:54.149975 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0202(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:43:54.150216 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:43:55.151712 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:43:55.161302 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:55.170798 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:55.181165 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 05 04:43:55.181165 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:55.181311 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 05 04:43:55.181311 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:55.181439 np0000004568 cinder-backup[101263]: WARNING os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 05 04:43:55.181439 np0000004568 cinder-backup[101263]: Jul 05 04:43:55.211982 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] Jul 05 04:43:55.211982 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] successful. Jul 05 04:43:55.211982 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:55.222191 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:43:55.232447 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:55.232447 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:43:55.232447 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:43:55.232447 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:43:55.232844 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:55.233048 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:43:55.233601 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] HCTL ('7', '-', '-', 0) found on session 223 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:43:55.233780 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:43:55.247307 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 223 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:43:55.247307 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:43:56.248842 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.130s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:43:56.249251 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2131ms) {'type': 'block', 'scsi_wwn': '330000000b80571bb', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:43:56.249376 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:43:56.267227 np0000004568 sudo[152539]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:43:56.267855 np0000004568 sudo[152539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:43:56.542340 np0000004568 sudo[152539]: pam_unix(sudo:session): session closed for user root Jul 05 04:43:56.544606 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.295s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:43:56.587281 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:43:56.592176 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_sha256file. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 05 04:43:56.638902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _read_sha256file finished. {{(pid=101263) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 05 04:43:56.645477 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: 07c2bfce-38ea-4dca-85ff-2f504b736058. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:43:56.662425 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058 {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:43:56.668081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: fe924c32-aae9-4fd7-9648-fce40834574e, volume size: 1073741824, object names prefix volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:43:56.861597 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:56.862243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 639 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:56.862385 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:56.883868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00001: 7455b0146d203e0450dd14035351df50 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:56.884056 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:56.884487 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:56.889580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 294912 bytes of data to 26532 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:56.889728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:56.910018 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00002: fb72c30027425b03602b5c428c05709b {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:56.910180 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:56.911871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:56.933250 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 2195456 bytes of data to 110362 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:56.933381 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:56.958144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00003: 1e7993f27aaa74904660f52df3349c14 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:56.958377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:56.959022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:56.960382 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 3974 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:56.960561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:56.981539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00004: e1554f9208060479cb8c0e2b20ce3092 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:56.981743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:56.982259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:56.988356 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 360448 bytes of data to 34483 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:56.988534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.010988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00005: 260e04b2b4be4a8fb9af5bcaeef77f5e {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.011135 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.011625 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.016060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 36108 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.016189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.037797 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00006: 7e4882497657c646c554c5ad835c0cf5 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.037985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.038261 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.038846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 338 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.038972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.061531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00007: d9cd9a4fb7c178bffad872b9fd1c6616 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.061732 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.062283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.085923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 524288 bytes of data to 272574 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.086102 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.108667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00008: 89771b482f431367ab05882b853a01a6 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.108829 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.109159 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.111053 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 18814 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.111166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.131949 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00009: 807f8f1c74646a8f9592027f16d2643d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.132108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.132305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.133299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 21396 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.133455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.152856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00010: 035de9616151b09d26063aaf3786be98 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.153011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.153478 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.168000 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 327680 bytes of data to 158643 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.168137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.195246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00011: f941eba3270410ec15b7aff819b8b0c0 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.195413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.195961 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.205943 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 327680 bytes of data to 62614 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.206165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.231146 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00012: ba683c210943a225502816568e3b8d00 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.231307 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.231629 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.233506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 14711 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.233650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.255489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00013: e88548713f69de90eef0cd6c4e9796dd {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.255872 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.256267 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.268650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 393216 bytes of data to 90143 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.268781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.290309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00014: 01e3e2d3510c4223690a6849e71496ab {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.290309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.290405 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.294466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 34865 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.294630 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.314200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00015: 599805a91aa71f961c3787a61e7c5729 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.314345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.314585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.316202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 7444 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.316314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.339255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00016: 179b961161bdaa477c7c01ad80585eee {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.339485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.339757 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.347846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 83926 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.347975 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.368865 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00017: d27aa048e7ec9b4cbc6afc435ead70f6 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.368958 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.369782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.398861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 786432 bytes of data to 349723 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.399022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.426458 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00018: 93a49a74b3f385db27466765f9e213d9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.426847 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.427187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.430954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 30511 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.430954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.453191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00019: fb0b4c9f443eae7a19740e071a10002c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.453191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.454922 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.541145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 2293760 bytes of data to 749878 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.541319 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.570493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00020: 74418bf98206d1f436cf326b4bf21f6c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.570666 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.571494 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.579548 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 60945 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.579728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.601484 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00021: 600a0ec270d9626014f041f394a91dec {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.601655 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.601903 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.604799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 21497 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.604919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.626158 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00022: d74672ad69032d6511c7f86b7b0cdb23 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.626331 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.626587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.630036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 16500 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.630314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.650068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00023: b26d859ed07de20dd16d0c165a4e6a3a {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.650259 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.650719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.659955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 294912 bytes of data to 60530 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.660110 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.684045 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00024: 17812a659c805b2d08ad0ffbac17f523 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.684220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.684554 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.686885 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 18150 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.686999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.709287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00025: 900ba3be5febaa4a7e8d4fe06a9e5bbe {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.709452 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.709650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.710888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 5224 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.711013 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.730964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00026: 7b83ad270600f54dc0ce5f973398f4a1 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.731122 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.731305 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.732560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 7895 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.732742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.754547 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00027: a31179c9f17d2086e474bbff2d8b9fa5 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.754718 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.754912 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.757776 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 16089 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.757902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.779652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00028: 86d6719d73ca0214c25634aedc7fe9d9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.779652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.779992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.783006 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 19002 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.783131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.802680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00029: fdf44fcafc023cb46fe41182b8e073b8 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.802902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.803639 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.822524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 524288 bytes of data to 110895 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.822692 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.845092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00030: 5815c96da9bc9be47f2dde7f69ddd130 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.845237 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.845539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.850577 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 37108 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.850706 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.872220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00031: 7ecd5b62ea9a77dd27d5058cc0b2af3a {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.872410 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.872859 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.881654 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 294912 bytes of data to 57886 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.881831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.904985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00032: 185eea5b60ee84638ea2ef67b051e400 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.905136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.905389 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.906855 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 6526 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.906979 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.926759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00033: e41a77e44d240ad8104d5fb9712151e4 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.926955 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.927148 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.929723 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 14907 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.929839 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.951964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00034: a7a0eee90ff873fe50f294cf33e7de2d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.952090 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.952248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.955925 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 32515 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.956038 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.976656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00035: 5a96fd0be63a553958c90d4a4316c4de {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.976826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:57.977039 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:57.979699 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 13305 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:57.979876 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:57.999747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00036: b02b4173598f30151430937bc55a6faf {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:57.999935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.000315 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.011988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 90046 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.012178 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.031168 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00037: b7e2d07e021e740544325541d67b7329 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.031330 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.031593 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.032389 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 2818 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.032534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.052522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00038: 00fb2cc13328ca425a2eca1e6c7c4e6d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.052522 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.052649 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.053787 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 5756 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.053902 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.072924 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00039: d11036511ad7f5dbe776a742c58f87ea {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.073080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.073266 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.073967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 1906 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.074086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.094499 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00040: c4ed5bf65e3847ac3a3103aeb9f043f9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.094728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.094970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.098493 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 6858 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.098742 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.122051 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00041: 2abba25a77ee36c58131400ef11e9b33 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.122185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.122418 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.125085 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 15768 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.125202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.146193 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00042: 58c33934aea3dc04d999003f5971d3e1 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.146340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.146550 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.148856 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 10944 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.148973 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.170923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00043: 90971d6560092661366d4a8e0d690316 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.171081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.171270 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.172433 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 5153 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.172561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.192832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00044: 6d63cabe5cbd45d0e7748b702fb3237f {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.192987 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.193247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.200778 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 229376 bytes of data to 56731 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.200886 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.224255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00045: b63363b73e33269b13a4b9007772caea {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.224423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.406524 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.407919 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 6383 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.408062 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.428974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00046: 7ad27b3399ebe8e17313a1edd45d2a4c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.429127 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.429325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.433370 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 29648 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.433518 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.454240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00047: b2f4bed0ea8034625ddd32034addd197 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.454431 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.454635 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.456854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 11536 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.456971 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.476975 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00048: e2ae44a38272f3786b389fe25de025f7 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.477113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.477290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.483705 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 60908 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.483854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.506099 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00049: 459edd959d71fc76632140b2c1c2afd7 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.506274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.506714 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.514583 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 49816 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.514760 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.535990 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00050: 9f03bd9a5f1f3681ce923853068a5391 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.536155 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.536419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.537375 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 3271 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.537622 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.556412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00051: 808b8e5ae0ebfa3ebee1f25e56d7380e {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.556629 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.558432 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.641058 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 2162688 bytes of data to 713033 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.641188 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.669003 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00052: 1a0ed9edc6ec5cba7d97f0476ffe1424 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.669165 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.669814 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.675500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 49711 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.675667 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.696587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00053: ac2c3b7f365746cfcedfa3644641f133 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.696751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.697108 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.708340 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 109962 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.708496 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.729825 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00054: d4e16afa8ee08db846e947df5b4ec08b {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.729999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.730446 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.744523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 106450 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.744751 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.767029 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00055: 86d6f3eb5f3f66b3bd977ec8c039a49c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.767166 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.767584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.773892 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 59932 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.774020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.794839 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00056: 933534e51561c890b382aa9eb4c5764c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.794982 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.795242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.796501 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 9062 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.796615 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.815359 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00057: 0f7cdc5b89fbb7316ab86f111715879e {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.815529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.815725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.818335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 23335 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.818530 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.838242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00058: b3534e7bd21436d93d6e15ceae51ecbb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.838403 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.838585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.843187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 36991 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.843287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.864354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00059: 308e5172c7191c405029e68eb339b63e {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.864504 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.864694 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.867827 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 27296 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.867945 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.890449 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00060: 87fed698449bb429c84cea142b47074f {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.890624 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.890801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:58.891860 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 6577 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:58.891998 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:58.917498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00061: 8577057e39906809834d6bbe62984d84 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:58.917684 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:58.919247 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.013380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 2162688 bytes of data to 835720 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.013609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.043145 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00062: 286f32389d41ccb3a7454011b7fe833b {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.043301 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.043964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.048698 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 32835 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.048816 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.070133 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00063: 07f83a91f2a65593c97ccde75e2cdb1a {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.070358 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.070657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.071631 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.071631 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.093173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00064: 472694eb9fd935b65a675e05db84ae55 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.093391 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.093643 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.102075 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 163840 bytes of data to 60928 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.102242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.123799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00065: 7bbd91225a7ad728f1ee251495d662a3 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.123956 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.124177 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.133771 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 89811 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.133954 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.155321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00066: 9c2c443a510acae20e828ca784ea0ef0 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.155512 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.155715 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.157060 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 10326 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.157173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.177052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00067: f15596026d78fb5a6c33e31e645c1bc0 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.177184 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.177376 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.181314 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 31811 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.181450 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.200585 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00068: 01e07b6ff49d49600cff2b5f037b5585 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.200743 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.200936 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.211964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 99152 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.212126 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.234089 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00069: 2cc1e5bb8b0f7f6b8f396071b242c82d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.234248 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.236086 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.341124 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 2555904 bytes of data to 1042244 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.341284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.373352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00070: 77a339075c2c22a3b220b8be3eafd00a {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.373531 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.374335 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.384541 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 64453 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.384724 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.406298 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00071: 4976e1dea54e67ed34a48147acf51f95 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.407473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.407473 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.407887 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 7823 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.408008 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.427344 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00072: c5102cf8b89d0646b4a8454aa2eb455b {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.427515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.427929 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.435240 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 50703 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.435406 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.455191 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00073: a90b39452df564cdaee1875cdf14648d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.455336 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.455637 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.465422 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 94089 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.465547 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.485807 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00074: 93190166bf0c7415bc69f707aeecba3d {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.485947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.486648 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.521871 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 753664 bytes of data to 382335 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.522011 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.547187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00075: f20b7ef7942c255d34567ef7a8c931d5 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.547386 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.548745 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.604049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 1245184 bytes of data to 692194 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.604235 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.630326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00076: 2fec27600c3cba1475524f3a83a147d9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.630557 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.631224 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.640974 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 229376 bytes of data to 86155 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.641082 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.662588 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00077: bd18e2aa13a8966c7ccaeb4a8d2ad111 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.662747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.663066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.675992 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 89989 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.676078 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.695448 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00078: 2742a11d6ef6f40794ba3a77fdd91fc1 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.695600 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.696287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.728310 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 753664 bytes of data to 244005 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.728475 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.754316 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00079: 937919e06f1ac884e907b3b44f7aa3f7 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.754523 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.754972 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.756372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 8385 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.756546 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.776088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00080: 80bf1a781b69ed6d28f051a8c1bace93 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.776246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.776498 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.780812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 35069 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.781004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.801659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00081: 839ea305330c068b1e25e10bbe0072eb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.801840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.802048 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.814930 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 101460 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.815083 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.837994 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00082: e35f12e70225bea64f1d64820a8c34af {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.838202 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.838455 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.839644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 27789 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.839785 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.860510 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00083: b64ba69a7c7b92cbb6e034a227c535e1 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.860719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.860951 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.869853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 163840 bytes of data to 57870 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.870098 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.892579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00084: 7271b184b3a0862c0307275252dd4c26 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.892759 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.892984 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.906559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 111151 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.906559 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.933016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00085: 534ab1b26cf91adf3fcf3f10f1b565b6 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.933171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.933803 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.947845 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 524288 bytes of data to 186707 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.948120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:43:59.975730 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00086: 3bf04c477bc894b2805da28a5a9dcb2c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:43:59.975947 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:43:59.976323 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:43:59.977467 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 3532 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:43:59.977602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.000300 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00087: eac5608ed25def357b0c151f30e9f0cb {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.000492 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.000754 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.001367 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 759 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.001549 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.024284 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00088: b13c893f91d348e49342fad0a19e7650 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.024544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.025094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.036579 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 262144 bytes of data to 93620 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.036808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.058966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00089: a77c3df81950fe3ec6756b32c47d5889 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.059172 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.289292 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.291380 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 14202 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.291529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.313702 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00090: c15a2e2eb7fb41df1e140bbf87c78a9c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.313842 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.314030 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.318532 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:44:00.318681 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:44:00.323970 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 196608 bytes of data to 99711 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.324095 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.348644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00091: d2f8fd157e57c49a2e7fbb7db668bdfa {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.348815 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.349004 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.353345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 24816 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.353345 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.374966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00092: ab4c3c6565d120e31d0ec092b1f40fc0 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.375143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.375360 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.376725 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 9379 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.376851 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.397657 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00093: 6df3fb11329fda670b6a648b803a75c3 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.397934 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.398181 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.399965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 11742 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.400094 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.424461 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00094: d3338725ce0b00d0d0a20c3dc76363b5 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.424884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.425242 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.452534 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 557056 bytes of data to 231400 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.452729 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.479419 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00095: 736df86bae8f6a9fbe7631cf877d988c {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.479545 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.479937 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.485416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 45214 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.485601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.512232 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00096: 5465c211d4134a5c770e5e96d9420f8b {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.512736 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.512736 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.514602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 3791 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.514602 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.543586 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00097: 125fb29df3a88ed91bb536861e7d1ff9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.543765 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.543978 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.547149 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 98304 bytes of data to 26004 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.547275 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.577222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00098: 38a20f8b3afb8be4ea4deab5f9b3d080 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.577222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.577222 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.583437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 34863 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.583437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.605515 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00099: f87eeae8e3222a88fc335a905cc595f5 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.605680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.605890 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.611120 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 131072 bytes of data to 28914 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.611238 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.633189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00100: a34ec244a0a06a62255379762d3da663 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.633356 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.633846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.654616 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 393216 bytes of data to 206685 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.654766 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.678215 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00101: ce40a8df09b1374e7997af78065811c8 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.678371 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.678680 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.679928 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 9850 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.680050 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.698824 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00102: 5649b75a126d07b66d0cec64e48b81cf {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.698953 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:00.699213 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:00.700151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:00.700304 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:00.718883 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00103: d6e3d8655826625cc9398019612e8c3f {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:00.719020 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:01.247161 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:01.247822 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:01.248192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:01.273652 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00104: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:01.273799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:01.647532 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:01.648209 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:01.648353 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:01.670187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00105: 6026aec7a55eb587767d8e7c13fd5c80 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:01.670324 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:02.194695 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:02.195294 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:02.195437 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:02.214719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00106: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:02.214866 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:02.538589 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:02.539369 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:02.539551 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:02.559773 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00107: 10a5524a8060c534f898c60929c7e0d1 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:02.559923 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:03.065402 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:03.066043 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:03.066189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:03.090012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00108: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:03.090204 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:03.691394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:03.692712 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 65536 bytes of data to 440 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:03.693036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:03.724782 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00109: 0ac0990c9ed447f0b51fba11845675aa {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:03.725036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:04.022323 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:04.022897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:04.023034 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:04.055019 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00110: ccd615116dcb4026c3f50f53f219fe04 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:04.055170 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:04.062540 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:44:04.067818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:44:04.068173 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:44:04.071967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:44:04.071967 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:44:04.075059 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 05 04:44:04.075320 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:44:04.124914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:44:04.125642 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:44:04.147169 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "07c2bfce-38ea-4dca-85ff-2f504b736058",\n "backup_name": "tempest-VolumesBackupsTest-Backup-401799486",\n "created_at": "2026-07-05 04:43:53+00:00",\n "objects": [\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00001": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7455b0146d203e0450dd14035351df50",\n "offset": 0\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00002": {\n "compression": "zlib",\n "length": 294912,\n "md5": "fb72c30027425b03602b5c428c05709b",\n "offset": 9437184\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00003": {\n "compression": "zlib",\n "length": 2195456,\n "md5": "1e7993f27aaa74904660f52df3349c14",\n "offset": 16023552\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00004": {\n "compression": "zlib",\n "length": 98304,\n "md5": "e1554f9208060479cb8c0e2b20ce3092",\n "offset": 20283392\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00005": {\n "compression": "zlib",\n "length": 360448,\n "md5": "260e04b2b4be4a8fb9af5bcaeef77f5e",\n "offset": 20414464\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00006": {\n "compression": "zlib",\n "length": 262144,\n "md5": "7e4882497657c646c554c5ad835c0cf5",\n "offset": 20840448\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00007": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d9cd9a4fb7c178bffad872b9fd1c6616",\n "offset": 21364736\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00008": {\n "compression": "zlib",\n "length": 524288,\n "md5": "89771b482f431367ab05882b853a01a6",\n "offset": 21528576\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00009": {\n "compression": "zlib",\n "length": 98304,\n "md5": "807f8f1c74646a8f9592027f16d2643d",\n "offset": 22085632\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00010": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035de9616151b09d26063aaf3786be98",\n "offset": 22282240\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00011": {\n "compression": "zlib",\n "length": 327680,\n "md5": "f941eba3270410ec15b7aff819b8b0c0",\n "offset": 22478848\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00012": {\n "compression": "zlib",\n "length": 327680,\n "md5": "ba683c210943a225502816568e3b8d00",\n "offset": 22872064\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00013": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e88548713f69de90eef0cd6c4e9796dd",\n "offset": 23265280\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00014": {\n "compression": "zlib",\n "length": 393216,\n "md5": "01e3e2d3510c4223690a6849e71496ab",\n "offset": 23396352\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00015": {\n "compression": "zlib",\n "length": 131072,\n "md5": "599805a91aa71f961c3787a61e7c5729",\n "offset": 23855104\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00016": {\n "compression": "zlib",\n "length": 65536,\n "md5": "179b961161bdaa477c7c01ad80585eee",\n "offset": 24051712\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00017": {\n "compression": "zlib",\n "length": 131072,\n "md5": "d27aa048e7ec9b4cbc6afc435ead70f6",\n "offset": 24510464\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00018": {\n "compression": "zlib",\n "length": 786432,\n "md5": "93a49a74b3f385db27466765f9e213d9",\n "offset": 24707072\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00019": {\n "compression": "zlib",\n "length": 65536,\n "md5": "fb0b4c9f443eae7a19740e071a10002c",\n "offset": 25624576\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00020": {\n "compression": "zlib",\n "length": 2293760,\n "md5": "74418bf98206d1f436cf326b4bf21f6c",\n "offset": 26214400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00021": {\n "compression": "zlib",\n "length": 262144,\n "md5": "600a0ec270d9626014f041f394a91dec",\n "offset": 28606464\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00022": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d74672ad69032d6511c7f86b7b0cdb23",\n "offset": 29032448\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00023": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b26d859ed07de20dd16d0c165a4e6a3a",\n "offset": 29425664\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00024": {\n "compression": "zlib",\n "length": 294912,\n "md5": "17812a659c805b2d08ad0ffbac17f523",\n "offset": 29622272\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00025": {\n "compression": "zlib",\n "length": 65536,\n "md5": "900ba3be5febaa4a7e8d4fe06a9e5bbe",\n "offset": 30081024\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00026": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7b83ad270600f54dc0ce5f973398f4a1",\n "offset": 30212096\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00027": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a31179c9f17d2086e474bbff2d8b9fa5",\n "offset": 30343168\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00028": {\n "compression": "zlib",\n "length": 98304,\n "md5": "86d6719d73ca0214c25634aedc7fe9d9",\n "offset": 32636928\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00029": {\n "compression": "zlib",\n "length": 98304,\n "md5": "fdf44fcafc023cb46fe41182b8e073b8",\n "offset": 32833536\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00030": {\n "compression": "zlib",\n "length": 524288,\n "md5": "5815c96da9bc9be47f2dde7f69ddd130",\n "offset": 33030144\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00031": {\n "compression": "zlib",\n "length": 131072,\n "md5": "7ecd5b62ea9a77dd27d5058cc0b2af3a",\n "offset": 33619968\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00032": {\n "compression": "zlib",\n "length": 294912,\n "md5": "185eea5b60ee84638ea2ef67b051e400",\n "offset": 33849344\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00033": {\n "compression": "zlib",\n "length": 32768,\n "md5": "e41a77e44d240ad8104d5fb9712151e4",\n "offset": 34275328\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00034": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a7a0eee90ff873fe50f294cf33e7de2d",\n "offset": 34406400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00035": {\n "compression": "zlib",\n "length": 65536,\n "md5": "5a96fd0be63a553958c90d4a4316c4de",\n "offset": 34537472\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00036": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b02b4173598f30151430937bc55a6faf",\n "offset": 38797312\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00037": {\n "compression": "zlib",\n "length": 262144,\n "md5": "b7e2d07e021e740544325541d67b7329",\n "offset": 38928384\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00038": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00fb2cc13328ca425a2eca1e6c7c4e6d",\n "offset": 39256064\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00039": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d11036511ad7f5dbe776a742c58f87ea",\n "offset": 40370176\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00040": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c4ed5bf65e3847ac3a3103aeb9f043f9",\n "offset": 40566784\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00041": {\n "compression": "zlib",\n "length": 32768,\n "md5": "2abba25a77ee36c58131400ef11e9b33",\n "offset": 40697856\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00042": {\n "compression": "zlib",\n "length": 65536,\n "md5": "58c33934aea3dc04d999003f5971d3e1",\n "offset": 40828928\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00043": {\n "compression": "zlib",\n "length": 65536,\n "md5": "90971d6560092661366d4a8e0d690316",\n "offset": 46399488\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00044": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6d63cabe5cbd45d0e7748b702fb3237f",\n "offset": 46596096\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00045": {\n "compression": "zlib",\n "length": 229376,\n "md5": "b63363b73e33269b13a4b9007772caea",\n "offset": 52199424\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00046": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7ad27b3399ebe8e17313a1edd45d2a4c",\n "offset": 52428800\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00047": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2f4bed0ea8034625ddd32034addd197",\n "offset": 52494336\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00048": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e2ae44a38272f3786b389fe25de025f7",\n "offset": 52592640\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00049": {\n "compression": "zlib",\n "length": 131072,\n "md5": "459edd959d71fc76632140b2c1c2afd7",\n "offset": 52756480\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00050": {\n "compression": "zlib",\n "length": 262144,\n "md5": "9f03bd9a5f1f3681ce923853068a5391",\n "offset": 52953088\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00051": {\n "compression": "zlib",\n "length": 32768,\n "md5": "808b8e5ae0ebfa3ebee1f25e56d7380e",\n "offset": 53280768\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00052": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "1a0ed9edc6ec5cba7d97f0476ffe1424",\n "offset": 53411840\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00053": {\n "compression": "zlib",\n "length": 131072,\n "md5": "ac2c3b7f365746cfcedfa3644641f133",\n "offset": 55640064\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00054": {\n "compression": "zlib",\n "length": 262144,\n "md5": "d4e16afa8ee08db846e947df5b4ec08b",\n "offset": 55869440\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00055": {\n "compression": "zlib",\n "length": 196608,\n "md5": "86d6f3eb5f3f66b3bd977ec8c039a49c",\n "offset": 56295424\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00056": {\n "compression": "zlib",\n "length": 196608,\n "md5": "933534e51561c890b382aa9eb4c5764c",\n "offset": 56557568\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00057": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0f7cdc5b89fbb7316ab86f111715879e",\n "offset": 56819712\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00058": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b3534e7bd21436d93d6e15ceae51ecbb",\n "offset": 56950784\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00059": {\n "compression": "zlib",\n "length": 65536,\n "md5": "308e5172c7191c405029e68eb339b63e",\n "offset": 57081856\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00060": {\n "compression": "zlib",\n "length": 98304,\n "md5": "87fed698449bb429c84cea142b47074f",\n "offset": 57212928\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00061": {\n "compression": "zlib",\n "length": 32768,\n "md5": "8577057e39906809834d6bbe62984d84",\n "offset": 57475072\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00062": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "286f32389d41ccb3a7454011b7fe833b",\n "offset": 57606144\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00063": {\n "compression": "zlib",\n "length": 131072,\n "md5": "07f83a91f2a65593c97ccde75e2cdb1a",\n "offset": 59834368\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00064": {\n "compression": "zlib",\n "length": 32768,\n "md5": "472694eb9fd935b65a675e05db84ae55",\n "offset": 60030976\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00065": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7bbd91225a7ad728f1ee251495d662a3",\n "offset": 60227584\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00066": {\n "compression": "zlib",\n "length": 196608,\n "md5": "9c2c443a510acae20e828ca784ea0ef0",\n "offset": 60489728\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00067": {\n "compression": "zlib",\n "length": 32768,\n "md5": "f15596026d78fb5a6c33e31e645c1bc0",\n "offset": 60751872\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00068": {\n "compression": "zlib",\n "length": 131072,\n "md5": "01e07b6ff49d49600cff2b5f037b5585",\n "offset": 60882944\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00069": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2cc1e5bb8b0f7f6b8f396071b242c82d",\n "offset": 61145088\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00070": {\n "compression": "zlib",\n "length": 2555904,\n "md5": "77a339075c2c22a3b220b8be3eafd00a",\n "offset": 61407232\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00071": {\n "compression": "zlib",\n "length": 196608,\n "md5": "4976e1dea54e67ed34a48147acf51f95",\n "offset": 64028672\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00072": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c5102cf8b89d0646b4a8454aa2eb455b",\n "offset": 64290816\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00073": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a90b39452df564cdaee1875cdf14648d",\n "offset": 64356352\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00074": {\n "compression": "zlib",\n "length": 196608,\n "md5": "93190166bf0c7415bc69f707aeecba3d",\n "offset": 64684032\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00075": {\n "compression": "zlib",\n "length": 753664,\n "md5": "f20b7ef7942c255d34567ef7a8c931d5",\n "offset": 64946176\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00076": {\n "compression": "zlib",\n "length": 1245184,\n "md5": "2fec27600c3cba1475524f3a83a147d9",\n "offset": 65863680\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00077": {\n "compression": "zlib",\n "length": 229376,\n "md5": "bd18e2aa13a8966c7ccaeb4a8d2ad111",\n "offset": 67174400\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00078": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2742a11d6ef6f40794ba3a77fdd91fc1",\n "offset": 67567616\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00079": {\n "compression": "zlib",\n "length": 753664,\n "md5": "937919e06f1ac884e907b3b44f7aa3f7",\n "offset": 67829760\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00080": {\n "compression": "zlib",\n "length": 32768,\n "md5": "80bf1a781b69ed6d28f051a8c1bace93",\n "offset": 68681728\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00081": {\n "compression": "zlib",\n "length": 98304,\n "md5": "839ea305330c068b1e25e10bbe0072eb",\n "offset": 68878336\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00082": {\n "compression": "zlib",\n "length": 196608,\n "md5": "e35f12e70225bea64f1d64820a8c34af",\n "offset": 69140480\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00083": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b64ba69a7c7b92cbb6e034a227c535e1",\n "offset": 69402624\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00084": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7271b184b3a0862c0307275252dd4c26",\n "offset": 69468160\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00085": {\n "compression": "zlib",\n "length": 196608,\n "md5": "534ab1b26cf91adf3fcf3f10f1b565b6",\n "offset": 69795840\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00086": {\n "compression": "zlib",\n "length": 524288,\n "md5": "3bf04c477bc894b2805da28a5a9dcb2c",\n "offset": 70254592\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00087": {\n "compression": "zlib",\n "length": 98304,\n "md5": "eac5608ed25def357b0c151f30e9f0cb",\n "offset": 71041024\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00088": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b13c893f91d348e49342fad0a19e7650",\n "offset": 71172096\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00089": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a77c3df81950fe3ec6756b32c47d5889",\n "offset": 72417280\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00090": {\n "compression": "zlib",\n "length": 65536,\n "md5": "c15a2e2eb7fb41df1e140bbf87c78a9c",\n "offset": 110100480\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00091": {\n "compression": "zlib",\n "length": 196608,\n "md5": "d2f8fd157e57c49a2e7fbb7db668bdfa",\n "offset": 110297088\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00092": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ab4c3c6565d120e31d0ec092b1f40fc0",\n "offset": 110559232\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00093": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6df3fb11329fda670b6a648b803a75c3",\n "offset": 110690304\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00094": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d3338725ce0b00d0d0a20c3dc76363b5",\n "offset": 110821376\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00095": {\n "compression": "zlib",\n "length": 557056,\n "md5": "736df86bae8f6a9fbe7631cf877d988c",\n "offset": 110952448\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00096": {\n "compression": "zlib",\n "length": 131072,\n "md5": "5465c211d4134a5c770e5e96d9420f8b",\n "offset": 111607808\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00097": {\n "compression": "zlib",\n "length": 32768,\n "md5": "125fb29df3a88ed91bb536861e7d1ff9",\n "offset": 111869952\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00098": {\n "compression": "zlib",\n "length": 98304,\n "md5": "38a20f8b3afb8be4ea4deab5f9b3d080",\n "offset": 112001024\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00099": {\n "compression": "zlib",\n "length": 131072,\n "md5": "f87eeae8e3222a88fc335a905cc595f5",\n "offset": 112197632\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00100": {\n "compression": "zlib",\n "length": 131072,\n "md5": "a34ec244a0a06a62255379762d3da663",\n "offset": 112590848\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00101": {\n "compression": "zlib",\n "length": 393216,\n "md5": "ce40a8df09b1374e7997af78065811c8",\n "offset": 113770496\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00102": {\n "compression": "zlib",\n "length": 32768,\n "md5": "5649b75a126d07b66d0cec64e48b81cf",\n "offset": 114229248\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00103": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d6e3d8655826625cc9398019612e8c3f",\n "offset": 143654912\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00104": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 277872640\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00105": {\n "compression": "zlib",\n "length": 65536,\n "md5": "6026aec7a55eb587767d8e7c13fd5c80",\n "offset": 412090368\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00106": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 546308096\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00107": {\n "compression": "zlib",\n "length": 65536,\n "md5": "10a5524a8060c534f898c60929c7e0d1",\n "offset": 680525824\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00108": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 814743552\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00109": {\n "compression": "zlib",\n "length": 65536,\n "md5": "0ac0990c9ed447f0b51fba11845675aa",\n "offset": 948961280\n }\n },\n {\n "volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00110": {\n "compression": "zlib",\n "length": 32768,\n "md5": "ccd615116dcb4026c3f50f53f219fe04",\n "offset": 1073709056\n }\n }\n ],\n "parent_id": "c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba",\n "version": "1.0.0",\n "volume_id": "fe924c32-aae9-4fd7-9648-fce40834574e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"fe924c32-aae9-4fd7-9648-fce40834574e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:42:32.000000\\", \\"launched_at\\": \\"2026-07-05T04:42:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1378559268\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:42:32.000000\\", \\"updated_at\\": \\"2026-07-05T04:43:53.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"e01f3214-b74f-47dd-a99b-2ae9aad3efec\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:44:04.153478 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] backup 07c2bfce-38ea-4dca-85ff-2f504b736058 finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:44:04.155017 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:44:04.172120 np0000004568 sudo[153177]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:44:04.172751 np0000004568 sudo[153177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:44:04.467503 np0000004568 sudo[153177]: pam_unix(sudo:session): session closed for user root Jul 05 04:44:04.469613 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.314s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:44:04.470421 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000b80571bb', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:44:04.470724 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:44:06.427644 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.957s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:44:06.428059 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe924c32-aae9-4fd7-9648-fce40834574e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:06.439293 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:06.439930 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:44:06.439930 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:44:06.439930 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:44:06.439930 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665 (non-flash) Jul 05 04:44:06.461944 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [225] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665 (non-flash) Jul 05 04:44:06.462198 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:44:06.462364 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786', '224'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dfab5b-be17-493d-9188-a9d350d56786', '225'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '226'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c4f1de3-1ebc-4db0-ba15-0f007b129665', '229')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:44:06.462441 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e', '223')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:44:06.463328 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fdedd17d80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:44:06.463536 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Removing multipathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:44:06.463785 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Flush multipath device 330000000b80571bb {{(pid=101263) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 05 04:44:06.631235 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:44:06.639263 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:44:06.684095 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:44:06.684306 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:44:06.685521 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:44:06.696119 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:44:06.696423 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:44:06.708016 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:06.742112 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] Jul 05 04:44:06.742112 np0000004568 cinder-backup[101263]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-fe924c32-aae9-4fd7-9648-fce40834574e, portal: 192.168.40.100,3260] successful. Jul 05 04:44:06.742112 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:06.762166 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:06.762424 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:44:06.762579 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (2291ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:44:07.792804 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-55c0edea-aced-42a5-833a-e167d69c5a2f tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: 07c2bfce-38ea-4dca-85ff-2f504b736058. Jul 05 04:44:08.846623 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: 07c2bfce-38ea-4dca-85ff-2f504b736058. Jul 05 04:44:08.856878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:44:08.857067 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:44:08.857255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] delete started, backup: 07c2bfce-38ea-4dca-85ff-2f504b736058, container: volumebackups, prefix: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:44:08.905500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00001', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00002', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00003', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00004', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00005', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00006', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00007', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00008', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00009', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00010', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00011', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00012', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00013', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00014', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00015', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00016', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00017', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00018', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00019', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00020', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00021', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00022', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00023', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00024', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00025', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00026', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00027', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00028', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00029', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00030', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00031', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00032', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00033', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00034', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00035', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00036', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00037', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00038', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00039', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00040', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00041', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00042', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00043', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00044', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00045', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00046', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00047', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00048', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00049', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00050', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00051', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00052', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00053', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00054', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00055', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00056', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00057', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00058', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00059', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00060', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00061', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00062', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00063', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00064', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00065', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00066', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00067', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00068', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00069', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00070', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00071', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00072', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00073', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00074', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00075', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00076', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00077', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00078', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00079', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00080', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00081', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00082', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00083', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00084', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00085', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00086', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00087', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00088', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00089', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00090', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00091', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00092', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00093', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00094', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00095', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00096', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00097', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00098', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00099', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00100', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00101', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00102', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00103', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00104', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00105', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00106', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00107', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00108', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00109', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00110', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_metadata', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:44:08.925216 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:08.943835 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:08.962136 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:08.979915 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:08.996696 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.012861 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.030601 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.048537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.066864 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.083283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.101395 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.120683 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.141068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.160740 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.185506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.204909 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.221097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.237103 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.259023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.290326 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.312472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.338980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00022 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.358591 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00023 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.382658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00024 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.401529 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00025 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.419412 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00026 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.442428 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00027 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.463791 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00028 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.488650 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00029 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.513632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00030 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.539708 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00031 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.557826 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00032 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.575016 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00033 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.594185 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00034 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.611891 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00035 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.632889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00036 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.652255 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00037 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.669645 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00038 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.688557 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00039 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.717338 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00040 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.742352 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00041 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.771009 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00042 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.793134 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00043 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.813747 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00044 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.837675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00045 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.866325 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00046 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.894210 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00047 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.915028 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00048 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.937057 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00049 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.961750 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00050 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:09.982821 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00051 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.007688 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00052 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.032117 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00053 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.056212 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00054 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.075445 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00055 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.104244 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00056 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.125444 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00057 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.149299 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00058 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.168263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00059 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.189472 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00060 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.208801 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00061 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.228537 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00062 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.247853 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00063 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.267049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00064 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.284290 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00065 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.301220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00066 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.318274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00067 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.338781 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00068 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.359868 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00069 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.379220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00070 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.405485 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00071 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.428889 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00072 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.448258 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00073 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.466491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00074 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.483724 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00075 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.501897 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00076 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.519525 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00077 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.536261 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00078 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.552786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00079 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.567993 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00080 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.584180 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00081 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.600372 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00082 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.616295 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00083 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.632526 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00084 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.649466 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00085 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.665675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00086 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.682022 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00087 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.698937 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00088 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.715435 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00089 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.731615 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00090 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.749561 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00091 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.768125 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00092 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.784144 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00093 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.803424 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00094 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.819092 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00095 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.835131 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00096 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.852223 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00097 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.874401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00098 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.891205 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00099 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.909658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00100 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.926578 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00101 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.943966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00102 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.964966 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00103 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:10.984377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00104 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.004939 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00105 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.023489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00106 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.046404 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00107 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.066587 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00108 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.086831 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00109 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.109128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058-00110 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.129691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.149592 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044356/az_nova_backup_07c2bfce-38ea-4dca-85ff-2f504b736058_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:11.149862 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] delete 07c2bfce-38ea-4dca-85ff-2f504b736058 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:44:11.182709 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:44:11.196672 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] Created reservations ['db1f4970-342a-4dc2-bfe6-f10193a0f0a9', '6d8479b0-b2c9-447c-8829-fefae65beee7'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:44:11.220363 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-812d144c-779d-4aec-940f-ae1418668ba7 tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup 07c2bfce-38ea-4dca-85ff-2f504b736058 deleted. Jul 05 04:44:12.336756 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba. Jul 05 04:44:12.340704 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:44:12.341113 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:44:12.341491 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] delete started, backup: c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba, container: volumebackups, prefix: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:44:12.391500 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00001', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00002', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00003', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00004', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00005', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00006', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00007', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00008', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00009', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00010', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00011', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00012', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00013', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00014', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00015', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00016', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00017', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00018', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00019', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00020', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00021', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_metadata', 'volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:44:12.413149 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.432686 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.454189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.482562 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.503829 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.521692 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.546015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.571189 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.595142 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.617850 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.636908 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.659539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.679662 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.702713 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.723128 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.743309 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.766840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.790012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.810786 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.832620 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.850544 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.876766 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.897946 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_fe924c32-aae9-4fd7-9648-fce40834574e/20260705044236/az_nova_backup_c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:12.898175 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] delete c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:44:12.929462 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:44:12.952958 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] Created reservations ['b419e9f3-5657-41ef-80d4-433ba210ae04', '8e7e1403-99b4-48b6-bf28-37abfc594825'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:44:12.966935 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-051a40af-e205-4b5e-803e-5468acb3e09c tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup c9e4fe52-7f99-43b9-8e32-9f7a15dc8bba deleted. Jul 05 04:44:15.837774 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Create backup started, backup: 3a2bf178-4906-4503-ba91-07c5093b214a volume: 47e95345-895a-4c29-b3af-fe74db8020dd snapshot: 63101bd5-7388-47e0-9523-04591f36be72. Jul 05 04:44:15.842766 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-05T04:44:15Z,data_timestamp=2026-07-05T04:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-323590894',encryption_key_id=None,fail_reason=None,host='np0000004568',id=3a2bf178-4906-4503-ba91-07c5093b214a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8d8f47c439224301aab1a833cea9c24f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='63101bd5-7388-47e0-9523-04591f36be72',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='418a6fadaf1d44969df596e7da41fde2',volume_id=47e95345-895a-4c29-b3af-fe74db8020dd) Jul 05 04:44:15.903927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:44:15.904552 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:44:15.905008 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.20', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:44:15.918333 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.scaleio [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101263) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 05 04:44:15.940146 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): nvme version {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:44:15.953434 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] 'nvme version' failed. Not Retrying. {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 04:44:15.953731 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] nvme not present on system {{(pid=101263) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 05 04:44:15.962326 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101263) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 05 04:44:15.963279 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.lightos [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Current host hostNQN and IP(s) are ['10.4.3.20', 'fe80::f816:3eff:fe29:fd01', '192.168.40.6', 'fe80::f816:3eff:feb5:10af', '192.168.50.6', 'fe80::f816:3eff:feef:d994', '192.168.10.6', 'fe80::f816:3eff:fed0:4718', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::38a2:aff:feb3:c946', 'fe80::f816:3eff:fe67:a56d', 'fe80::bc2c:3bff:fea4:d6c3', 'fe80::f816:3eff:fe21:f252', 'fe80::f8dd:d9ff:fea4:5a89'] Jul 05 04:44:15.963475 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 05 04:44:15.963543 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.lightos [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] LIGHTOS: no hostnqn found. {{(pid=101263) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 05 04:44:15.963814 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.20', 'host': 'np0000004568', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6761786382d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'f0172b75-ae82-4001-9dc0-0a33839f16f2', 'nvme_native_multipath': False} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:44:16.466920 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connector [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Factory for iscsi on None {{(pid=101263) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 05 04:44:16.467331 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:44:16.467503 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:44:16.468040 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:44:16.468316 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 05 04:44:16.478973 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:44:16.479385 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:44:16.479614 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:44:16.488160 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 05 04:44:16.488160 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901] added Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: stderr=iscsiadm: Config file line 363 does not have value Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: iscsiadm: Config file line 363 does not have value Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 05 04:44:16.497273 np0000004568 cinder-backup[101263]: {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:16.497501 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101263) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 05 04:44:16.497777 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0181(s), this was the 1st time calling it. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 05 04:44:16.497962 np0000004568 cinder-backup[101263]: DEBUG os_brick.utils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101263) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 05 04:44:17.499905 np0000004568 cinder-backup[101263]: INFO os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.name = iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.tpgt = -1 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.startup = manual Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.leading_login = No Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.iscsi_ifacename = default Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.net_ifacename = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.ipaddress = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.prefix_len = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.hwaddress = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.transport_name = tcp Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.initiatorname = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.vlan_id = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.vlan_priority = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.vlan_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.iface_num = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.mtu = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.port = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.bootproto = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.subnet_mask = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.gateway = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_alt_client_id = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_dns = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_learn_iqn = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_req_vendor_id_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_vendor_id = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.dhcp_slp_da = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.fragmentation = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.gratuitous_arp = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.incoming_forwarding = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tos_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tos = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.ttl = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.delayed_ack = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tcp_nagle = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tcp_wsf_state = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tcp_wsf = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tcp_timer_scale = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.tcp_timestamp = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.redirect = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.def_task_mgmt_timeout = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.header_digest = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.data_digest = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.immediate_data = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.initial_r2t = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.data_seq_inorder = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.data_pdu_inorder = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.erl = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.max_receive_data_len = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.first_burst_len = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.max_outstanding_r2t = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.max_burst_len = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.chap_auth = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.bidi_chap = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.strict_login_compliance = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.discovery_auth = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: iface.discovery_logout = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.discovery_address = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.discovery_port = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.discovery_type = fw Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.initial_cmdsn = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.initial_login_retry_max = 8 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.xmit_thread_priority = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.cmds_max = 128 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.queue_depth = 32 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.nr_sessions = 1 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.authmethod = None Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.username = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.password = *** Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.username_in = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.password_in = Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.auth.chap_algs = SHA256 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.timeo.replacement_timeout = 120 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.err_timeo.abort_timeout = 15 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.err_timeo.lu_reset_timeout = 30 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.err_timeo.host_reset_timeout = 60 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.FastAbort = Yes Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.InitialR2T = No Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.ImmediateData = Yes Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.FirstBurstLength = 262144 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxBurstLength = 16776192 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Retain = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.DefaultTime2Wait = 2 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxConnections = 1 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.iscsi.ERL = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.scan = auto Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.session.reopen_max = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].address = 192.168.40.100 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].port = 3260 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].startup = manual Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].tcp.window_size = 524288 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].tcp.type_of_service = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].timeo.logout_timeout = 15 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].timeo.login_timeout = 15 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].timeo.auth_timeout = 45 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_interval = 5 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].timeo.noop_out_timeout = 5 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.HeaderDigest = None Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.DataDigest = None Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.IFMarker = No Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: node.conn[0].iscsi.OFMarker = No Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: # END RECORD Jul 05 04:44:17.509618 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:17.519634 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:17.530848 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.530848 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.530848 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:17.531016 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.531016 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.531016 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:44:17.566638 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901, portal: 192.168.40.100,3260] Jul 05 04:44:17.566638 np0000004568 cinder-backup[101263]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901, portal: 192.168.40.100,3260] successful. Jul 05 04:44:17.566638 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:17.577967 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:17.589476 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.589476 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.589476 np0000004568 cinder-backup[101263]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 (non-flash) Jul 05 04:44:17.589476 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:17.589693 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.589693 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:17.589693 np0000004568 cinder-backup[101263]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 (non-flash) Jul 05 04:44:17.589693 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:44:17.590061 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:44:17.590230 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Connected to 192.168.40.100:3260 {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 05 04:44:17.591032 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] HCTL ('7', '-', '-', 0) found on session 230 with lun 0 {{(pid=101263) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 05 04:44:17.591087 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101263) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 05 04:44:17.606280 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Searching for a device in session 230 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101263) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 05 04:44:17.606280 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101263) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 05 04:44:18.605864 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.138s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:44:18.608583 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] <== connect_volume: return (2138ms) {'type': 'block', 'scsi_wwn': '3300000004e95998a', 'path': '/dev/sdb'} {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:44:18.608583 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:44:18.626195 np0000004568 sudo[153514]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 05 04:44:18.626809 np0000004568 sudo[153514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:44:18.902189 np0000004568 sudo[153514]: pam_unix(sudo:session): session closed for user root Jul 05 04:44:18.906590 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.297s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:44:18.941255 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:44:18.946154 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _create_container started, container: volumebackups,backup: 3a2bf178-4906-4503-ba91-07c5093b214a. {{(pid=101263) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 05 04:44:18.976556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] generate_object_name_prefix: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a {{(pid=101263) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 05 04:44:18.980469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] starting backup of volume: 47e95345-895a-4c29-b3af-fe74db8020dd, volume size: 1073741824, object names prefix volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a, availability zone: nova {{(pid=101263) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 05 04:44:19.169603 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:19.413910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:19.413910 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:19.514063 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:19.514394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:19.687140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:19.935927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:19.935927 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:20.035636 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:20.035841 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:20.206287 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:20.447999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:20.448245 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:20.549681 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:20.549895 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:20.723726 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:20.970613 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:20.970805 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:21.089609 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:21.089811 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:21.310505 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:21.554236 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:21.554378 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:21.663777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:21.664015 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:21.839964 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:22.095103 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:22.095263 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:22.200533 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:22.200748 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:22.379818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:22.624806 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:22.624980 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:22.724658 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:22.724827 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:22.898192 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:23.144719 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:23.144933 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:23.241281 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:23.241464 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:23.443582 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:23.683812 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:23.684023 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:23.784354 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:23.784560 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:23.958795 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:24.204031 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:24.204229 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:24.302168 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:24.302339 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:24.484777 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:24.724985 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:24.725097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:24.820423 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:24.820656 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:24.985140 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:25.233088 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:25.233186 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:25.330645 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:25.330834 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:25.506321 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:25.741401 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:25.741539 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:25.839416 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:25.839553 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:26.019935 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:26.266489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:26.266679 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:26.362628 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:26.362824 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:26.545065 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:26.786083 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:26.786211 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:26.883469 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:26.883675 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:27.054097 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:27.302143 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:27.302281 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:27.401542 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:27.401542 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:27.580901 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:27.831280 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:27.831394 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:27.931878 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:27.932471 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:28.116119 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:28.369171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:28.369171 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:28.466621 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:28.466808 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:28.643218 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:28.885848 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:28.885996 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:28.982187 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:28.982365 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:29.161200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:29.412999 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:29.413200 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:29.520632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:29.520632 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:29.628068 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Backing up chunk of data from volume. {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 05 04:44:29.744644 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101263) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 05 04:44:29.744926 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] About to put_object {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 05 04:44:29.815659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup MD5 for volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 05 04:44:29.815659 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Calling eventlet.sleep(0) {{(pid=101263) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 05 04:44:29.823012 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 05 04:44:29.828846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101263) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 05 04:44:29.828846 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-metadata' {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 05 04:44:29.832690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-metadata' available {{(pid=101263) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 05 04:44:29.832690 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Getting metadata type 'volume-glance-metadata' {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 05 04:44:29.835605 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.driver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] No metadata type 'volume-glance-metadata' available {{(pid=101263) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 05 04:44:29.835832 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_sha256file. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 05 04:44:29.897607 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _write_sha256file finished. {{(pid=101263) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 05 04:44:29.898413 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _write_metadata started, container name: volumebackups, metadata filename: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_metadata. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 05 04:44:29.922049 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3a2bf178-4906-4503-ba91-07c5093b214a",\n "backup_name": "tempest-VolumesBackupsTest-Backup-323590894",\n "created_at": "2026-07-05 04:44:16+00:00",\n "objects": [\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "47e95345-895a-4c29-b3af-fe74db8020dd",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"47e95345-895a-4c29-b3af-fe74db8020dd\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"418a6fadaf1d44969df596e7da41fde2\\", \\"project_id\\": \\"8d8f47c439224301aab1a833cea9c24f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004568@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-05T04:44:14.000000\\", \\"launched_at\\": \\"2026-07-05T04:44:14.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-857808908\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"716a9331-c074-495d-ae3e-a2fc71ed6efa\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"f45ab009-e882-4d79-8665-6d232490a731\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-05T04:44:13.000000\\", \\"updated_at\\": \\"2026-07-05T04:44:14.000000\\"}}"\n}'. {{(pid=101263) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 05 04:44:29.928036 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] backup 3a2bf178-4906-4503-ba91-07c5093b214a finished. {{(pid=101263) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 05 04:44:30.054935 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 04:44:30.073519 np0000004568 sudo[153618]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 05 04:44:30.074208 np0000004568 sudo[153618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 05 04:44:30.384507 np0000004568 sudo[153618]: pam_unix(sudo:session): session closed for user root Jul 05 04:44:30.386954 np0000004568 cinder-backup[101263]: DEBUG oslo_concurrency.processutils [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.332s {{(pid=101263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 04:44:30.387704 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004e95998a', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 05 04:44:30.388008 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 05 04:44:30.388467 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 05 04:44:30.388893 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: iSNS: Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: STATIC: Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Portal: 192.168.50.100:3260,-1 Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Target: iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Portal: 192.168.40.100:3260,-1 Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: Iface Name: default Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: FIRMWARE: Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: No targets found. Jul 05 04:44:30.400881 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:30.401270 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 05 04:44:30.401270 np0000004568 cinder-backup[101263]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 05 04:44:30.401270 np0000004568 cinder-backup[101263]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101263) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 05 04:44:30.401476 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', 0)] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 05 04:44:30.429779 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('-m', 'session'): stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:30.429779 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:30.429779 np0000004568 cinder-backup[101263]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 (non-flash) Jul 05 04:44:30.429779 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 05 04:44:30.430010 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsi session list stdout=tcp: [226] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:30.430010 np0000004568 cinder-backup[101263]: tcp: [227] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01 (non-flash) Jul 05 04:44:30.430010 np0000004568 cinder-backup[101263]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901 (non-flash) Jul 05 04:44:30.430010 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 05 04:44:30.430105 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '226'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-069fdc6d-a7b7-40bb-a1a8-0cbc53b15b01', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', '230')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 05 04:44:30.430261 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901', '230')] {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 05 04:44:30.431172 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Resulting device map defaultdict(. at 0x77fdedb20c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901'): ({'sdb'}, set())}) {{(pid=101263) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 05 04:44:30.431382 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Removing single pathed devices sdb {{(pid=101263) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 05 04:44:30.443736 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Flushing IO for device /dev/sdb {{(pid=101263) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 05 04:44:30.453448 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101263) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 05 04:44:30.509076 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 05 04:44:30.509262 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] SCSI volumes sdb have been removed. {{(pid=101263) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 05 04:44:30.510421 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 05 04:44:30.523155 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.linuxscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101263) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 05 04:44:30.523416 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901')] {{(pid=101263) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 05 04:44:30.536150 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:30.565325 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901, portal: 192.168.40.100,3260] Jul 05 04:44:30.565325 np0000004568 cinder-backup[101263]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-e6a38ec8-e3f0-4d92-a29e-2b43aa754901, portal: 192.168.40.100,3260] successful. Jul 05 04:44:30.565325 np0000004568 cinder-backup[101263]: stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:30.580670 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101263) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 05 04:44:30.580988 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.base [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.192s {{(pid=101263) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 05 04:44:30.581219 np0000004568 cinder-backup[101263]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] <== disconnect_volume: return (193ms) None {{(pid=101263) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 05 04:44:31.617401 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-3e2d4b7d-765b-4e2c-b634-c90c274ac032 tempest-VolumesBackupsTest-1691274772 None] Create backup finished. backup: 3a2bf178-4906-4503-ba91-07c5093b214a. Jul 05 04:44:32.168584 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] Delete backup started, backup: 3a2bf178-4906-4503-ba91-07c5093b214a. Jul 05 04:44:32.174936 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_8d8f47c439224301aab1a833cea9c24f {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:44:32.175080 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:44:32.175238 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] delete started, backup: 3a2bf178-4906-4503-ba91-07c5093b214a, container: volumebackups, prefix: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:44:32.223376 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] generated object list: ['volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00001', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00002', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00003', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00004', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00005', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00006', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00007', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00008', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00009', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00010', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00011', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00012', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00013', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00014', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00015', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00016', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00017', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00018', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00019', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00020', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00021', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_metadata', 'volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:44:32.242417 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.262000 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.281002 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.298738 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.315818 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.341137 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.358854 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.376624 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.393896 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.413982 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.431363 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.452799 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.471489 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.487809 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.505840 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.525796 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.544350 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.561556 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.580593 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.598066 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.619010 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.635708 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.654273 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] deleted object: volume_47e95345-895a-4c29-b3af-fe74db8020dd/20260705044418/az_nova_backup_3a2bf178-4906-4503-ba91-07c5093b214a_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:32.654580 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] delete 3a2bf178-4906-4503-ba91-07c5093b214a finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:44:32.687262 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:44:32.699221 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] Created reservations ['0725e769-9cf4-493a-8e46-35e3733586ac', '56bd362e-89ee-4a28-83a0-fe2f3e143b51'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:44:32.712738 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-10a9b473-a72c-4a6e-bb00-18819994d18f tempest-VolumesBackupsTest-1691274772 None] Delete backup finished, backup 3a2bf178-4906-4503-ba91-07c5093b214a deleted. Jul 05 04:44:42.711521 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=89,cinder:UPDATE=33,cinder:INSERT=6 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:44:48.369794 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] Delete backup started, backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6. Jul 05 04:44:48.373379 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] Using swift URL https://10.4.3.20:8080/v1/AUTH_f7b59b49c01547eea71bf55ecda7b781 {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 05 04:44:48.373965 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.drivers.swift [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] Connect to https://10.4.3.20:8080/v1/AUTH_ in "per_user" mode {{(pid=101263) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 05 04:44:48.374246 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] delete started, backup: 08164d0c-a4e9-413f-833b-8b0bab5f51c6, container: volumebackups, prefix: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 05 04:44:48.426283 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] generated object list: ['volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata', 'volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_sha256file']. {{(pid=101263) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 05 04:44:48.451660 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00001 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.471884 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00002 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.489914 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00003 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.508151 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00004 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.525691 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00005 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.541888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00006 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.557506 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00007 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.573888 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00008 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.591377 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00009 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.609052 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00010 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.626465 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00011 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.642081 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00012 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.657599 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00013 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.675254 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00014 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.695728 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00015 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.712584 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00016 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.730274 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00017 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.746565 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00018 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.762243 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00019 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.780220 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00020 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.796395 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6-00021 in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.811988 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_metadata in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.827190 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] deleted object: volume_6f68cd36-998a-455d-89f9-531d2e0c3751/20260705044309/az_nova_backup_08164d0c-a4e9-413f-833b-8b0bab5f51c6_sha256file in container: volumebackups. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 05 04:44:48.827397 np0000004568 cinder-backup[101263]: DEBUG cinder.backup.chunkeddriver [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] delete 08164d0c-a4e9-413f-833b-8b0bab5f51c6 finished. {{(pid=101263) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 05 04:44:48.860625 np0000004568 cinder-backup[101263]: DEBUG oslo_db.sqlalchemy.engines [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 04:44:48.873113 np0000004568 cinder-backup[101263]: DEBUG cinder.quota [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] Created reservations ['f42754df-60a1-4790-84ae-4c74a4dda14e', '172f7787-eead-4ae1-a6cb-dd237ca9d733'] {{(pid=101263) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 04:44:48.886484 np0000004568 cinder-backup[101263]: INFO cinder.backup.manager [None req-8844d6c8-5992-44db-a0db-c11780f022b1 tempest-TestVolumeBackupRestore-1269666036 None] Delete backup finished, backup 08164d0c-a4e9-413f-833b-8b0bab5f51c6 deleted. Jul 05 04:44:58.885390 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:45:00.322546 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:45:00.323125 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:45:37.259717 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:46:00.327307 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:46:00.327725 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:47:00.330737 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:47:00.331251 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:47:37.261009 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:48:00.333650 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:48:00.334148 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:49:00.338444 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:49:00.338915 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:49:37.260694 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 04:50:00.343830 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:50:00.344294 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:51:00.347345 np0000004568 cinder-backup[101263]: DEBUG oslo_service.periodic_task [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101263) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 04:51:00.347860 np0000004568 cinder-backup[101263]: DEBUG cinder.manager [None req-5dab748b-e1da-4f74-acc1-b3359d827743 None None] Notifying Schedulers of capabilities ... {{(pid=101263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 04:51:37.263731 np0000004568 cinder-backup[101263]: DEBUG dbcounter [-] [101263] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}