Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateJul 22, 2024 9:38
Duration1h 45m
Framework TestFlows 2.0.240708.1162538

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63d4d92ec52dfe1f25bef0361a280f15cdae6e2e
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
with_minioFalse
with_s3amazonTrue
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

95.2%OK
3.3%Known
1.5%Fail

Statistics

Units OK Fail XFail
Modules
1
1
Features
1
1
Scenarios
94
89
5
Checks
92
90
2
Examples
84
78
2
4
Steps
13282
12694
582
6

Known Fails

Test NameResultMessage
/tiered storage/with s3amazon/alter table policyXFail 1ms
Investigating
None
/tiered storage/with s3amazon/double move while selectXFail 6s 104ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 265, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/with s3amazon/manual move with downtimeXFail 646ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 376, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 277, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 80, in scenario
    node.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 276, in command
    return self.cluster.command(self.name, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1971, in command
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Mv: target '/external/store/*/*/detached/.' is not a directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1971 in 'command'

1963\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1964\|                  if steps
1965\|                  else NullStep()
1966\|              ):
1967\|                  if str(exitcode).startswith("!="):
1968\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1969\|                      assert r.exitcode != exitcode, error(r.output)
1970\|                  else:
1971\|>                     assert r.exitcode == exitcode, error(r.output)
1972\|  
1973\|          if messages is None:
1974\|              messages = []

Results

Test Name Result Duration
/tiered storage OK 1h 45m
/tiered storage/with s3amazon OK 1h 45m
/tiered storage/with s3amazon/startup and queries OK 36s 614ms
/tiered storage/with s3amazon/metadata OK 6s 924ms
/tiered storage/with s3amazon/no changes to queries OK 16s 79ms
/tiered storage/with s3amazon/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 15s 19ms
/tiered storage/with s3amazon/system tables OK 194ms
/tiered storage/with s3amazon/system․detached_parts OK 1s 719ms
/tiered storage/with s3amazon/attach or replace partition different policies OK 517ms
/tiered storage/with s3amazon/query parser OK 603ms
/tiered storage/with s3amazon/keep free space OK 10s 350ms
/tiered storage/with s3amazon/no warning about zero max data part size OK 514ms
/tiered storage/with s3amazon/round robin OK 1s 145ms
/tiered storage/with s3amazon/max data part size OK 9s 571ms
/tiered storage/with s3amazon/jbod overflow OK 53s 579ms
/tiered storage/with s3amazon/start stop moves OK 22s 388ms
/tiered storage/with s3amazon/mutate to another disk OK 10s 725ms
/tiered storage/with s3amazon/alter table policy XFail 1ms
/tiered storage/with s3amazon/simple replication and moves OK 1m 4s
/tiered storage/with s3amazon/download appropriate disk OK 16s 669ms
/tiered storage/with s3amazon/download appropriate disk advanced OK 18s 270ms
/tiered storage/with s3amazon/download appropriate disk max data part size OK 31s 4ms
/tiered storage/with s3amazon/rename OK 6s 749ms
/tiered storage/with s3amazon/freeze OK 9s 314ms
/tiered storage/with s3amazon/double move while select XFail 6s 104ms
/tiered storage/with s3amazon/background move OK 5m 2s
/tiered storage/with s3amazon/alter move OK 22m 21s
/tiered storage/with s3amazon/manual move with downtime XFail 646ms
/tiered storage/with s3amazon/merge parts different volumes OK 13s 850ms
/tiered storage/with s3amazon/merge parts different volumes no space OK 5s 271ms
/tiered storage/with s3amazon/ttl moves OK 1h 4m
/tiered storage/with s3amazon/change config norestart OK 5m 26s

Generated by TestFlows Open-Source Test Framework v2.0.240708.1162538