Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateJul 22, 2024 9:30
Duration1h 47m
Framework TestFlows 2.0.240708.1162538

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63d4d92ec52dfe1f25bef0361a280f15cdae6e2e
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsTrue
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

97.8%OK
2.2%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
1
1
Scenarios
94
91
3
Checks
92
92
Examples
84
81
3
Steps
12678
12452
220
6

Known Fails

Test NameResultMessage
/tiered storage/with s3gcs/double move while selectXFail 6s 462ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 265, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/with s3gcs/manual move with downtimeXFail 1s 169ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 277, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 80, in scenario
    node.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 276, in command
    return self.cluster.command(self.name, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1971, in command
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Mv: target '/external/store/*/*/detached/.' is not a directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1971 in 'command'

1963\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1964\|                  if steps
1965\|                  else NullStep()
1966\|              ):
1967\|                  if str(exitcode).startswith("!="):
1968\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1969\|                      assert r.exitcode != exitcode, error(r.output)
1970\|                  else:
1971\|>                     assert r.exitcode == exitcode, error(r.output)
1972\|  
1973\|          if messages is None:
1974\|              messages = []

Results

Test Name Result Duration
/tiered storage OK 1h 47m
/tiered storage/with s3gcs OK 1h 47m
/tiered storage/with s3gcs/startup and queries OK 37s 258ms
/tiered storage/with s3gcs/metadata OK 8s 855ms
/tiered storage/with s3gcs/no changes to queries OK 11s 439ms
/tiered storage/with s3gcs/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 16s 624ms
/tiered storage/with s3gcs/system tables OK 367ms
/tiered storage/with s3gcs/system․detached_parts OK 3s 84ms
/tiered storage/with s3gcs/attach or replace partition different policies OK 814ms
/tiered storage/with s3gcs/query parser OK 1s 3ms
/tiered storage/with s3gcs/keep free space OK 18s 714ms
/tiered storage/with s3gcs/no warning about zero max data part size OK 803ms
/tiered storage/with s3gcs/round robin OK 1s 875ms
/tiered storage/with s3gcs/max data part size OK 10s 132ms
/tiered storage/with s3gcs/jbod overflow OK 46s 875ms
/tiered storage/with s3gcs/start stop moves OK 23s 639ms
/tiered storage/with s3gcs/mutate to another disk OK 11s 96ms
/tiered storage/with s3gcs/alter table policy OK 33s 59ms
/tiered storage/with s3gcs/simple replication and moves OK 1m 16s
/tiered storage/with s3gcs/download appropriate disk OK 10s 464ms
/tiered storage/with s3gcs/download appropriate disk advanced OK 25s 250ms
/tiered storage/with s3gcs/download appropriate disk max data part size OK 27s 8ms
/tiered storage/with s3gcs/rename OK 9s 145ms
/tiered storage/with s3gcs/freeze OK 7s 251ms
/tiered storage/with s3gcs/double move while select XFail 6s 462ms
/tiered storage/with s3gcs/background move OK 5m 11s
/tiered storage/with s3gcs/alter move OK 19m 40s
/tiered storage/with s3gcs/manual move with downtime XFail 1s 169ms
/tiered storage/with s3gcs/merge parts different volumes OK 14s 383ms
/tiered storage/with s3gcs/merge parts different volumes no space OK 9s 396ms
/tiered storage/with s3gcs/ttl moves OK 1h 7m
/tiered storage/with s3gcs/change config norestart OK 5m 59s

Generated by TestFlows Open-Source Test Framework v2.0.240708.1162538