Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateMar 19, 2024 17:46
Duration1h 40m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
version23.3.19.34.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash33e216283b93dd5abbf62952196526ca4c182703
job.id8247806903
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8247806903
archx86_64
stressFalse
with_minioFalse
with_s3amazonTrue
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_key_secretSecret(name='gcs_key_secret')
gcs_key_idSecret(name='gcs_key_id')
gcs_uriSecret(name='gcs_uri')
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
collect_service_logsTrue

Summary

90.9%OK
9.1%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
2
2
Scenarios
93
84
9
Examples
3
3
Steps
12143
11834
308
1

Known Fails

Test NameResultMessage
/tiered storage/with s3amazon/normal/query parserXFail 1s 18ms
Incorrect message https://github.com/ClickHouse/ClickHouse/pull/51854
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 216, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/query_parser.py", line 101, in scenario
    node.query(sql, message, exitcode)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 836, in query
    assert message in r.output, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Description
  Received exception from server (version 23.3.19):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)
(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'
)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception: New storage policy `moving_jbod_with_external` shall contain volumes of the old storage policy `default`.'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = "Received exception from server (version 23.3.19):\nCode: 36. DB::Exception: Received from localhost:9000. DB::Exception: New storage policy `default` shall contain volumes of old one. (BAD_ARGUMENTS)\n(query: ALTER TABLE table_with_normal_policy MODIFY SETTING storage_policy='moving_jbod_with_external'\n)"
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 836 in 'query'

828\|                  assert r.exitcode == exitcode, error(r.output)
829\|  
830\|          if message is not None:
831\|              with (
832\|                  Then(f"output should contain message", description=message)
833\|                  if steps
834\|                  else NullStep()
835\|              ):
836\|>                 assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
/tiered storage/with s3amazon/normal/alter table policyXFail 1ms
Investigating
None
/tiered storage/with s3amazon/normal/double move while selectXFail 7s 637ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 417, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 404, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 288, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage OK 1h 40m
/tiered storage/with s3amazon OK 1h 40m
/tiered storage/with s3amazon/normal OK 1h 38m
/tiered storage/with s3amazon/normal/startup and queries OK 34s 374ms
/tiered storage/with s3amazon/normal/metadata OK 6s 342ms
/tiered storage/with s3amazon/normal/no changes to queries OK 8s 919ms
/tiered storage/with s3amazon/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 16s 533ms
/tiered storage/with s3amazon/normal/system tables OK 282ms
/tiered storage/with s3amazon/normal/system.detached_parts OK 2s 181ms
/tiered storage/with s3amazon/normal/attach or replace partition different policies OK 862ms
/tiered storage/with s3amazon/normal/query parser XFail 1s 18ms
/tiered storage/with s3amazon/normal/keep free space OK 12s 868ms
/tiered storage/with s3amazon/normal/no warning about zero max data part size OK 815ms
/tiered storage/with s3amazon/normal/round robin OK 1s 610ms
/tiered storage/with s3amazon/normal/max data part size OK 8s 373ms
/tiered storage/with s3amazon/normal/jbod overflow OK 40s 110ms
/tiered storage/with s3amazon/normal/start stop moves OK 22s 383ms
/tiered storage/with s3amazon/normal/mutate to another disk OK 15s 993ms
/tiered storage/with s3amazon/normal/alter table policy XFail 1ms
/tiered storage/with s3amazon/normal/simple replication and moves OK 43s 624ms
/tiered storage/with s3amazon/normal/download appropriate disk OK 9s 61ms
/tiered storage/with s3amazon/normal/download appropriate disk advanced OK 20s 810ms
/tiered storage/with s3amazon/normal/download appropriate disk max data part size OK 23s 537ms
/tiered storage/with s3amazon/normal/rename OK 6s 588ms
/tiered storage/with s3amazon/normal/freeze OK 5s 349ms
/tiered storage/with s3amazon/normal/double move while select XFail 7s 637ms
/tiered storage/with s3amazon/normal/background move OK 4m 50s
/tiered storage/with s3amazon/normal/alter move OK 23m 1s
/tiered storage/with s3amazon/normal/merge parts different volumes OK 13s 930ms
/tiered storage/with s3amazon/normal/merge parts different volumes no space OK 6s 558ms
/tiered storage/with s3amazon/normal/ttl moves OK 59m 31s
/tiered storage/with s3amazon/normal/change config norestart OK 5m 44s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232