Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateJul 22, 2024 9:25
Duration1h 47m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriNone
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

95.6%OK
2.9%Known
1.5%Fail

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
94
90
4
Checks
92
89
3
Examples
84
79
1
4
Steps
12847
12623
212
6
6

Known Fails

Test NameResultMessage
/tiered storage/normal/double move while selectXFail 7s 627ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 265, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/normal/manual move with downtimeXFail 1s 237ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 277, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 109, in scenario
    assert all_paths_start_with_external, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert all_paths_start_with_external, error()

Assertion values
  assert all_paths_start_with_external, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py', line 109 in 'scenario'

101\|  
102\|                      with And(f"all paths should start with '{external_dir}'"):
103\|                          all_paths_start_with_external = all(
104\|                              path.startswith(external_dir)
105\|                              for path in get_paths_for_partition_from_part_log(
106\|                                  node, name, "201904"
107\|                              )[:2]
108\|                          )
109\|>                         assert all_paths_start_with_external, error()
110\|  
111\|                  with When("I manually move partition 201904 to back disk 'jbod1'"):
112\|                      node.query(f"ALTER TABLE {name} DETACH PARTITION 201904")

Results

Test Name Result Duration
/tiered storage OK 1h 47m
/tiered storage/normal OK 1h 47m
/tiered storage/normal/startup and queries OK 39s 21ms
/tiered storage/normal/metadata OK 12s 290ms
/tiered storage/normal/no changes to queries OK 12s 854ms
/tiered storage/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 14s 131ms
/tiered storage/normal/system tables OK 219ms
/tiered storage/normal/system․detached_parts OK 4s 686ms
/tiered storage/normal/attach or replace partition different policies OK 598ms
/tiered storage/normal/query parser OK 732ms
/tiered storage/normal/keep free space OK 23s 104ms
/tiered storage/normal/no warning about zero max data part size OK 635ms
/tiered storage/normal/round robin OK 1s 536ms
/tiered storage/normal/max data part size OK 8s 490ms
/tiered storage/normal/jbod overflow OK 51s 812ms
/tiered storage/normal/start stop moves OK 24s 425ms
/tiered storage/normal/mutate to another disk OK 20s 567ms
/tiered storage/normal/alter table policy OK 34s 760ms
/tiered storage/normal/simple replication and moves OK 1m 10s
/tiered storage/normal/download appropriate disk OK 4s 619ms
/tiered storage/normal/download appropriate disk advanced OK 22s 936ms
/tiered storage/normal/download appropriate disk max data part size OK 12s 498ms
/tiered storage/normal/rename OK 10s 817ms
/tiered storage/normal/freeze OK 10s 334ms
/tiered storage/normal/double move while select XFail 7s 627ms
/tiered storage/normal/background move OK 6m 52s
/tiered storage/normal/alter move OK 14m 0s
/tiered storage/normal/manual move with downtime XFail 1s 237ms
/tiered storage/normal/merge parts different volumes OK 11s 720ms
/tiered storage/normal/merge parts different volumes no space OK 32s 60ms
/tiered storage/normal/ttl moves OK 1h 10m
/tiered storage/normal/change config norestart OK 6m 13s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204