Tiered Storage Test Run Report

DateMar 01, 2024 21:33
Duration1h 36m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archaarch64
stressFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriNone
gcs_key_secretNone
gcs_key_idNone
gcs_uriNone
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
collect_service_logsTrue

Summary

92%OK
8%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
2
2
Scenarios
94
86
8
Examples
3
3
Steps
12465
12239
225
1

Known Fails

Test NameResultMessage
/tiered storage/normal/normal/query parserXFail 1s 286ms
Incorrect message https://github.com/ClickHouse/ClickHouse/pull/51854
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 216, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/query_parser.py", line 101, in scenario
    node.query(sql, message, exitcode)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 836, in query
    assert message in r.output, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Description
  Received exception from server (version 23.3.19):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)
(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'
)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception: New storage policy `moving_jbod_with_external` shall contain volumes of the old storage policy `default`.'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = "Received exception from server (version 23.3.19):\nCode: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)\n(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'\n)"
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 836 in 'query'

828\|                  assert r.exitcode == exitcode, error(r.output)
829\|  
830\|          if message is not None:
831\|              with (
832\|                  Then(f"output should contain message", description=message)
833\|                  if steps
834\|                  else NullStep()
835\|              ):
836\|>                 assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
/tiered storage/normal/normal/double move while selectXFail 7s 139ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 288, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage OK 1h 36m
/tiered storage/normal OK 1h 36m
/tiered storage/normal/normal OK 1h 34m
/tiered storage/normal/normal/startup and queries OK 38s 630ms
/tiered storage/normal/normal/metadata OK 11s 260ms
/tiered storage/normal/normal/no changes to queries OK 12s 451ms
/tiered storage/normal/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 13s 549ms
/tiered storage/normal/normal/system tables OK 291ms
/tiered storage/normal/normal/system.detached_parts OK 4s 864ms
/tiered storage/normal/normal/attach or replace partition different policies OK 905ms
/tiered storage/normal/normal/query parser XFail 1s 286ms
/tiered storage/normal/normal/keep free space OK 23s 357ms
/tiered storage/normal/normal/no warning about zero max data part size OK 948ms
/tiered storage/normal/normal/round robin OK 1s 959ms
/tiered storage/normal/normal/max data part size OK 8s 347ms
/tiered storage/normal/normal/jbod overflow OK 49s 43ms
/tiered storage/normal/normal/start stop moves OK 23s 761ms
/tiered storage/normal/normal/mutate to another disk OK 20s 100ms
/tiered storage/normal/normal/alter table policy OK 33s 487ms
/tiered storage/normal/normal/simple replication and moves OK 1m 6s
/tiered storage/normal/normal/download appropriate disk OK 4s 741ms
/tiered storage/normal/normal/download appropriate disk advanced OK 23s 832ms
/tiered storage/normal/normal/download appropriate disk max data part size OK 13s 13ms
/tiered storage/normal/normal/rename OK 10s 305ms
/tiered storage/normal/normal/freeze OK 9s 847ms
/tiered storage/normal/normal/double move while select XFail 7s 139ms
/tiered storage/normal/normal/background move OK 6m 55s
/tiered storage/normal/normal/alter move OK 11m 53s
/tiered storage/normal/normal/manual move with downtime OK 4s 698ms
/tiered storage/normal/normal/merge parts different volumes OK 12s 195ms
/tiered storage/normal/normal/merge parts different volumes no space OK 26s 894ms
/tiered storage/normal/normal/ttl moves OK 1h 2m
/tiered storage/normal/normal/change config norestart OK 6m 18s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232