Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateMay 25, 2023 21:38
Duration2h 50m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinityfips/5080932159/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
version22.8.15.25.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63a15b5dfc55badefcf4b869296e3ec99ca08141
job.id5080932159
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/5080932159
archx86_64
stressFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsTrue
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_key_secretSecret(name='gcs_key_secret')
gcs_key_idSecret(name='gcs_key_id')
gcs_uriSecret(name='gcs_uri')
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
collect_service_logsTrue

Summary

89.9%OK
4%Known
6.1%Error

Statistics

Units OK Fail Error XFail
Modules
1
1
Suites
1
1
Features
1
1
Scenarios
93
86
3
4
Examples
3
3
Steps
12818
12304
508
5
1

Fails

Test NameResultMessage
/tiered storageError 2h 50m
TimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 57, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_move.py", line 103, in scenario
    task.result(timeout=600)
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 460, in result
    raise TimeoutError()
concurrent.futures._base.TimeoutError
/tiered storage/with s3gcsError 2h 50m
TimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 57, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_move.py", line 103, in scenario
    task.result(timeout=600)
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 460, in result
    raise TimeoutError()
concurrent.futures._base.TimeoutError
/tiered storage/with s3gcs/alter moveError 1h 11m
TimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 57, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_move.py", line 103, in scenario
    task.result(timeout=600)
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 460, in result
    raise TimeoutError()
concurrent.futures._base.TimeoutError

Known Fails

Test NameResultMessage
/tiered storage/with s3gcs/double move while selectXFail 20s 875ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 276, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage Error 2h 50m
/tiered storage/with s3gcs Error 2h 50m
/tiered storage/with s3gcs/startup and queries OK 51s 435ms
/tiered storage/with s3gcs/metadata OK 15s 57ms
/tiered storage/with s3gcs/no changes to queries OK 19s 601ms
/tiered storage/with s3gcs/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 21s 434ms
/tiered storage/with s3gcs/system tables OK 268ms
/tiered storage/with s3gcs/system.detached_parts OK 3s 302ms
/tiered storage/with s3gcs/attach or replace partition different policies OK 656ms
/tiered storage/with s3gcs/query parser OK 788ms
/tiered storage/with s3gcs/keep free space OK 16s 132ms
/tiered storage/with s3gcs/no warning about zero max data part size OK 683ms
/tiered storage/with s3gcs/round robin OK 1s 525ms
/tiered storage/with s3gcs/max data part size OK 18s 936ms
/tiered storage/with s3gcs/jbod overflow OK 57s 926ms
/tiered storage/with s3gcs/start stop moves OK 51s 478ms
/tiered storage/with s3gcs/mutate to another disk OK 1m 4s
/tiered storage/with s3gcs/alter table policy OK 54s 142ms
/tiered storage/with s3gcs/simple replication and moves OK 1m 15s
/tiered storage/with s3gcs/download appropriate disk OK 20s 483ms
/tiered storage/with s3gcs/download appropriate disk advanced OK 27s 238ms
/tiered storage/with s3gcs/download appropriate disk max data part size OK 53s 22ms
/tiered storage/with s3gcs/rename OK 12s 272ms
/tiered storage/with s3gcs/freeze OK 7s 945ms
/tiered storage/with s3gcs/double move while select XFail 20s 875ms
/tiered storage/with s3gcs/background move OK 7m 25s
/tiered storage/with s3gcs/alter move Error 1h 11m
/tiered storage/with s3gcs/merge parts different volumes OK 21s 766ms
/tiered storage/with s3gcs/merge parts different volumes no space OK 14s 910ms
/tiered storage/with s3gcs/ttl moves OK 1h 12m
/tiered storage/with s3gcs/change config norestart OK 6m 35s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122