Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateNov 05, 2024 18:25
Duration1h 47m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriNone
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

95.6%OK
2.9%Known
1.5%Fail

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
94
90
4
Checks
92
89
3
Examples
84
79
1
4
Steps
12864
12633
219
6
6

Known Fails

Test NameResultMessage
/tiered storage/normal/double move while selectXFail 7s 917ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 265, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/normal/manual move with downtimeXFail 1s 249ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 277, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 109, in scenario
    assert all_paths_start_with_external, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert all_paths_start_with_external, error()

Assertion values
  assert all_paths_start_with_external, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py', line 109 in 'scenario'

101\|  
102\|                      with And(f"all paths should start with '{external_dir}'"):
103\|                          all_paths_start_with_external = all(
104\|                              path.startswith(external_dir)
105\|                              for path in get_paths_for_partition_from_part_log(
106\|                                  node, name, "201904"
107\|                              )[:2]
108\|                          )
109\|>                         assert all_paths_start_with_external, error()
110\|  
111\|                  with When("I manually move partition 201904 to back disk 'jbod1'"):
112\|                      node.query(f"ALTER TABLE {name} DETACH PARTITION 201904")

Results

Test Name Result Duration
/tiered storage OK 1h 47m
/tiered storage/normal OK 1h 47m
/tiered storage/normal/startup and queries OK 38s 610ms
/tiered storage/normal/metadata OK 12s 27ms
/tiered storage/normal/no changes to queries OK 13s 296ms
/tiered storage/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 13s 82ms
/tiered storage/normal/system tables OK 217ms
/tiered storage/normal/system․detached_parts OK 4s 736ms
/tiered storage/normal/attach or replace partition different policies OK 593ms
/tiered storage/normal/query parser OK 721ms
/tiered storage/normal/keep free space OK 22s 943ms
/tiered storage/normal/no warning about zero max data part size OK 630ms
/tiered storage/normal/round robin OK 1s 452ms
/tiered storage/normal/max data part size OK 8s 528ms
/tiered storage/normal/jbod overflow OK 51s 600ms
/tiered storage/normal/start stop moves OK 24s 150ms
/tiered storage/normal/mutate to another disk OK 21s 234ms
/tiered storage/normal/alter table policy OK 35s 281ms
/tiered storage/normal/simple replication and moves OK 1m 11s
/tiered storage/normal/download appropriate disk OK 4s 498ms
/tiered storage/normal/download appropriate disk advanced OK 22s 743ms
/tiered storage/normal/download appropriate disk max data part size OK 12s 560ms
/tiered storage/normal/rename OK 10s 805ms
/tiered storage/normal/freeze OK 10s 801ms
/tiered storage/normal/double move while select XFail 7s 917ms
/tiered storage/normal/background move OK 6m 54s
/tiered storage/normal/alter move OK 13m 21s
/tiered storage/normal/manual move with downtime XFail 1s 249ms
/tiered storage/normal/merge parts different volumes OK 11s 658ms
/tiered storage/normal/merge parts different volumes no space OK 30s 528ms
/tiered storage/normal/ttl moves OK 1h 10m
/tiered storage/normal/change config norestart OK 6m 10s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204