Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateMar 01, 2024 21:03
Duration1h 55m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash21f7d5d9a06ffe799a5197cf71b00c2c8376c4ef
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archaarch64
stressFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsTrue
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_key_secretSecret(name='gcs_key_secret')
gcs_key_idSecret(name='gcs_key_id')
gcs_uriSecret(name='gcs_uri')
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
collect_service_logsTrue

Summary

91.9%OK
8.1%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
2
2
Scenarios
93
85
8
Examples
3
3
Steps
12286
12062
223
1

Known Fails

Test NameResultMessage
/tiered storage/with s3gcs/normal/query parserXFail 1s 197ms
Incorrect message https://github.com/ClickHouse/ClickHouse/pull/51854
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 216, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/query_parser.py", line 101, in scenario
    node.query(sql, message, exitcode)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 836, in query
    assert message in r.output, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Description
  Received exception from server (version 23.3.19):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)
(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'
)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception: New storage policy `moving_jbod_with_external` shall contain volumes of the old storage policy `default`.'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = "Received exception from server (version 23.3.19):\nCode: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)\n(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'\n)"
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 836 in 'query'

828\|                  assert r.exitcode == exitcode, error(r.output)
829\|  
830\|          if message is not None:
831\|              with (
832\|                  Then(f"output should contain message", description=message)
833\|                  if steps
834\|                  else NullStep()
835\|              ):
836\|>                 assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
/tiered storage/with s3gcs/normal/double move while selectXFail 10s 80ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 288, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage OK 1h 55m
/tiered storage/with s3gcs OK 1h 55m
/tiered storage/with s3gcs/normal OK 1h 53m
/tiered storage/with s3gcs/normal/startup and queries OK 43s 40ms
/tiered storage/with s3gcs/normal/metadata OK 13s 27ms
/tiered storage/with s3gcs/normal/no changes to queries OK 14s 741ms
/tiered storage/with s3gcs/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 14s 462ms
/tiered storage/with s3gcs/normal/system tables OK 278ms
/tiered storage/with s3gcs/normal/system.detached_parts OK 4s 751ms
/tiered storage/with s3gcs/normal/attach or replace partition different policies OK 897ms
/tiered storage/with s3gcs/normal/query parser XFail 1s 197ms
/tiered storage/with s3gcs/normal/keep free space OK 22s 308ms
/tiered storage/with s3gcs/normal/no warning about zero max data part size OK 941ms
/tiered storage/with s3gcs/normal/round robin OK 1s 831ms
/tiered storage/with s3gcs/normal/max data part size OK 11s 987ms
/tiered storage/with s3gcs/normal/jbod overflow OK 56s 563ms
/tiered storage/with s3gcs/normal/start stop moves OK 28s 977ms
/tiered storage/with s3gcs/normal/mutate to another disk OK 32s 968ms
/tiered storage/with s3gcs/normal/alter table policy OK 38s 91ms
/tiered storage/with s3gcs/normal/simple replication and moves OK 1m 8s
/tiered storage/with s3gcs/normal/download appropriate disk OK 8s 939ms
/tiered storage/with s3gcs/normal/download appropriate disk advanced OK 25s 146ms
/tiered storage/with s3gcs/normal/download appropriate disk max data part size OK 23s 828ms
/tiered storage/with s3gcs/normal/rename OK 12s 484ms
/tiered storage/with s3gcs/normal/freeze OK 10s 656ms
/tiered storage/with s3gcs/normal/double move while select XFail 10s 80ms
/tiered storage/with s3gcs/normal/background move OK 7m 49s
/tiered storage/with s3gcs/normal/alter move OK 26m 30s
/tiered storage/with s3gcs/normal/merge parts different volumes OK 14s 191ms
/tiered storage/with s3gcs/normal/merge parts different volumes no space OK 26s 671ms
/tiered storage/with s3gcs/normal/ttl moves OK 1h 4m
/tiered storage/with s3gcs/normal/change config norestart OK 6m 20s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232