Tiered Storage Test Run Report

DateJul 22, 2024 9:22
Duration1h 52m
Framework TestFlows 2.0.240708.1162538

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63d4d92ec52dfe1f25bef0361a280f15cdae6e2e
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
with_minioTrue
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

95.6%OK
2.9%Known
1.5%Fail

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
94
90
4
Checks
92
89
3
Examples
84
79
1
4
Steps
12844
12615
217
6
6

Known Fails

Test NameResultMessage
/tiered storage/with minio/double move while selectXFail 10s 652ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 265, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/with minio/manual move with downtimeXFail 1s 316ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 277, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 83, in scenario
    node.query(f"ALTER TABLE {name} ATTACH PARTITION 201904")
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1079, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 24.3.5):
Code: 27. DB::Exception: Received from localhost:9000. DB::Exception: Cannot parse input: expected '\n' before: 'columns format version: 1\n2 columns:\n`EventDate` Date\n`number` UInt64\n'. (CANNOT_PARSE_INPUT_ASSERTION_FAILED)
(query: ALTER TABLE manual_move_mt ATTACH PARTITION 201904
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1079 in 'query'

1071\|                  assert message in r.output, error(r.output)
1072\|  
1073\|          if not ignore_exception:
1074\|              if message is None or "Exception:" not in message:
1075\|                  with Then("check if output has exception") if steps else NullStep():
1076\|                      if "Exception:" in r.output:
1077\|                          if raise_on_exception:
1078\|                              raise QueryRuntimeException(r.output)
1079\|>                         assert False, error(r.output)
1080\|  
1081\|          return r
1082\|

Results

Test Name Result Duration
/tiered storage OK 1h 52m
/tiered storage/with minio OK 1h 52m
/tiered storage/with minio/startup and queries OK 42s 875ms
/tiered storage/with minio/metadata OK 14s 254ms
/tiered storage/with minio/no changes to queries OK 17s 277ms
/tiered storage/with minio/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 13s 412ms
/tiered storage/with minio/system tables OK 247ms
/tiered storage/with minio/system․detached_parts OK 6s 764ms
/tiered storage/with minio/attach or replace partition different policies OK 811ms
/tiered storage/with minio/query parser OK 898ms
/tiered storage/with minio/keep free space OK 27s 135ms
/tiered storage/with minio/no warning about zero max data part size OK 765ms
/tiered storage/with minio/round robin OK 1s 715ms
/tiered storage/with minio/max data part size OK 10s 262ms
/tiered storage/with minio/jbod overflow OK 58s 293ms
/tiered storage/with minio/start stop moves OK 28s 912ms
/tiered storage/with minio/mutate to another disk OK 22s 391ms
/tiered storage/with minio/alter table policy OK 39s 795ms
/tiered storage/with minio/simple replication and moves OK 1m 19s
/tiered storage/with minio/download appropriate disk OK 5s 628ms
/tiered storage/with minio/download appropriate disk advanced OK 24s 38ms
/tiered storage/with minio/download appropriate disk max data part size OK 14s 39ms
/tiered storage/with minio/rename OK 12s 545ms
/tiered storage/with minio/freeze OK 12s 410ms
/tiered storage/with minio/double move while select XFail 10s 652ms
/tiered storage/with minio/background move OK 7m 49s
/tiered storage/with minio/alter move OK 15m 42s
/tiered storage/with minio/manual move with downtime XFail 1s 316ms
/tiered storage/with minio/merge parts different volumes OK 12s 330ms
/tiered storage/with minio/merge parts different volumes no space OK 37s 406ms
/tiered storage/with minio/ttl moves OK 1h 11m
/tiered storage/with minio/change config norestart OK 6m 16s

Generated by TestFlows Open-Source Test Framework v2.0.240708.1162538