Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateMar 02, 2024 1:16
Duration1h 42m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash484851c0de2ab8fdd96bbb1911bf3154f3e8b9a7
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archx86_64
stressFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsTrue
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_key_secretSecret(name='gcs_key_secret')
gcs_key_idSecret(name='gcs_key_id')
gcs_uriSecret(name='gcs_uri')
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
collect_service_logsTrue

Summary

92.9%OK
7.1%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
2
2
Scenarios
93
86
7
Examples
3
3
Steps
12505
12203
301
1

Known Fails

Test NameResultMessage
/tiered storage/with s3gcs/normal/query parserXFail 1s 194ms
Incorrect message https://github.com/ClickHouse/ClickHouse/pull/51854
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 216, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/query_parser.py", line 101, in scenario
    node.query(sql, message, exitcode)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 836, in query
    assert message in r.output, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Description
  Received exception from server (version 23.3.19):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)
(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'
)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception: New storage policy `moving_jbod_with_external` shall contain volumes of the old storage policy `default`.'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = "Received exception from server (version 23.3.19):\nCode: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)\n(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'\n)"
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 836 in 'query'

828\|                  assert r.exitcode == exitcode, error(r.output)
829\|  
830\|          if message is not None:
831\|              with (
832\|                  Then(f"output should contain message", description=message)
833\|                  if steps
834\|                  else NullStep()
835\|              ):
836\|>                 assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
/tiered storage/with s3gcs/normal/double move while selectXFail 7s 597ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 288, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage OK 1h 42m
/tiered storage/with s3gcs OK 1h 42m
/tiered storage/with s3gcs/normal OK 1h 40m
/tiered storage/with s3gcs/normal/startup and queries OK 33s 613ms
/tiered storage/with s3gcs/normal/metadata OK 7s 892ms
/tiered storage/with s3gcs/normal/no changes to queries OK 9s 710ms
/tiered storage/with s3gcs/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 16s 511ms
/tiered storage/with s3gcs/normal/system tables OK 287ms
/tiered storage/with s3gcs/normal/system.detached_parts OK 2s 636ms
/tiered storage/with s3gcs/normal/attach or replace partition different policies OK 791ms
/tiered storage/with s3gcs/normal/query parser XFail 1s 194ms
/tiered storage/with s3gcs/normal/keep free space OK 15s 39ms
/tiered storage/with s3gcs/normal/no warning about zero max data part size OK 869ms
/tiered storage/with s3gcs/normal/round robin OK 1s 778ms
/tiered storage/with s3gcs/normal/max data part size OK 11s 555ms
/tiered storage/with s3gcs/normal/jbod overflow OK 44s 443ms
/tiered storage/with s3gcs/normal/start stop moves OK 20s 464ms
/tiered storage/with s3gcs/normal/mutate to another disk OK 23s 708ms
/tiered storage/with s3gcs/normal/alter table policy OK 31s 146ms
/tiered storage/with s3gcs/normal/simple replication and moves OK 48s 982ms
/tiered storage/with s3gcs/normal/download appropriate disk OK 11s 597ms
/tiered storage/with s3gcs/normal/download appropriate disk advanced OK 22s 686ms
/tiered storage/with s3gcs/normal/download appropriate disk max data part size OK 27s 398ms
/tiered storage/with s3gcs/normal/rename OK 7s 959ms
/tiered storage/with s3gcs/normal/freeze OK 5s 960ms
/tiered storage/with s3gcs/normal/double move while select XFail 7s 597ms
/tiered storage/with s3gcs/normal/background move OK 4m 56s
/tiered storage/with s3gcs/normal/alter move OK 21m 45s
/tiered storage/with s3gcs/normal/merge parts different volumes OK 14s 609ms
/tiered storage/with s3gcs/normal/merge parts different volumes no space OK 7s 90ms
/tiered storage/with s3gcs/normal/ttl moves OK 1h 1m
/tiered storage/with s3gcs/normal/change config norestart OK 5m 30s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232