Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateNov 05, 2024 18:25
Duration2h 23m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

87.6%OK
11.5%Known

Statistics

Units Skip OK Fail Error XFail
Modules
2
2
Features
13
13
Scenarios
184
3
143
38
Checks
15
15
Examples
71
70
1
Steps
175242
175213
9
6
14

Known Fails

Test NameResultMessage
/s3/minio/disk/cacheXFail 2ms
Under development for 22.8 and newer.
None
/s3/minio/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio/disk/cache pathXFail 961us
Under development for 22.8 and newer.
None
/s3/minio/disk/low cardinality offsetXFail 44s 526ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 323, in minio_regression
    Feature(test=load("s3.tests.disk", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2461, in minio
    disk_tests(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2431, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2394, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2394 in 'low_cardinality_offset'

2386\|                      "1",
2387\|                  ),
2388\|                  (
2389\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2390\|                      "1",
2391\|                  ),
2392\|              ],
2393\|          ).output
2394\|>         assert output == "23999\n", error()
2395\|  
2396\|  
2397\|  @TestFeature
/s3/minio/disk/no restartXFail 2ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/minio/invalid disk/cache path conflictXFail 2ms
Under development for 22.8 and newer.
None
/s3/minio/zero copy replication/deleteXFail 10m 36s
test is slow to clean up, needs investigation
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 332, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1720, in minio
    outline(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1692, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 826, in delete
    check_bucket_size(expected_size=size_before, tolerance=5)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 814, in check_bucket_size
    assert abs(current_size - expected_size) <= tolerance, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert abs(current_size - expected_size) <= tolerance, error()

Assertion values
  assert abs(current_size - expected_size) <= tolerance, error()
             ^ is 9541612
  assert abs(current_size - expected_size) <= tolerance, error()
                            ^ is 122538737
  assert abs(current_size - expected_size) <= tolerance, error()
                          ^ is = -112997125
  assert abs(current_size - expected_size) <= tolerance, error()
         ^ is = 112997125
  assert abs(current_size - expected_size) <= tolerance, error()
                                              ^ is 5
  assert abs(current_size - expected_size) <= tolerance, error()
                                           ^ is = False
  assert abs(current_size - expected_size) <= tolerance, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 814 in 'check_bucket_size'

806\|  ):
807\|      current_size = get_bucket_size(
808\|          name=name,
809\|          prefix=prefix,
810\|          minio_enabled=minio_enabled,
811\|          access_key=self.context.secret_access_key,
812\|          key_id=self.context.access_key_id,
813\|      )
814\|>     assert abs(current_size - expected_size) <= tolerance, error()
815\|  
816\|  
817\|  @TestStep(When)

Results

Test Name Result Duration
/s3 OK 2h 23m
/s3/minio OK 2h 23m
/s3/minio/sanity OK 56s 204ms
/s3/minio/sanity/sanity OK 12s 161ms
/s3/minio/table function OK 2m 10s
/s3/minio/table function/auto OK 5s 742ms
/s3/minio/table function/compression OK 5s 939ms
/s3/minio/table function/credentials OK 717ms
/s3/minio/table function/data format OK 13s 333ms
/s3/minio/table function/measure file size OK 46s 95ms
/s3/minio/table function/multipart OK 6s 585ms
/s3/minio/table function/multiple columns OK 932ms
/s3/minio/table function/partition OK 323ms
/s3/minio/table function/remote host filter OK 44s 236ms
/s3/minio/table function/syntax OK 998ms
/s3/minio/table function/wildcard OK 5s 688ms
/s3/minio/backup OK 5m 52s
/s3/minio/backup/local and s3 disk OK 1m 56s
/s3/minio/backup/local and s3 volumes OK 1m 58s
/s3/minio/backup/s3 disk OK 1m 58s
/s3/minio/invalid table function OK 2s 544ms
/s3/minio/invalid table function/empty path OK 304ms
/s3/minio/invalid table function/empty structure OK 275ms
/s3/minio/invalid table function/invalid compression OK 286ms
/s3/minio/invalid table function/invalid credentials OK 481ms
/s3/minio/invalid table function/invalid format OK 635ms
/s3/minio/invalid table function/invalid path OK 294ms
/s3/minio/invalid table function/invalid structure OK 255ms
/s3/minio/disk OK 41m 15s
/s3/minio/disk/access OK 43s 690ms
/s3/minio/disk/access skip check OK 43s 779ms
/s3/minio/disk/add storage OK 1m 28s
/s3/minio/disk/alter move OK 50s 207ms
/s3/minio/disk/alter on cluster modify ttl OK 1m 32s
/s3/minio/disk/cache XFail 2ms
/s3/minio/disk/cache default XFail 1ms
/s3/minio/disk/cache path XFail 961us
/s3/minio/disk/compact parts OK 44s 175ms
/s3/minio/disk/config over restart OK 59s 875ms
/s3/minio/disk/default move factor OK 1m 13s
/s3/minio/disk/delete OK 1m 50s
/s3/minio/disk/download appropriate disk OK 1m 14s
/s3/minio/disk/drop sync OK 1m 19s
/s3/minio/disk/environment credentials Skip 1ms
/s3/minio/disk/exports OK 43s 977ms
/s3/minio/disk/generic url Skip 965us
/s3/minio/disk/imports OK 44s 101ms
/s3/minio/disk/log OK 4m 28s
/s3/minio/disk/low cardinality offset XFail 44s 526ms
/s3/minio/disk/max single part upload size syntax OK 44s 467ms
/s3/minio/disk/mergetree OK 8m 2s
/s3/minio/disk/mergetree collapsing OK 1m 30s
/s3/minio/disk/mergetree versionedcollapsing OK 1m 32s
/s3/minio/disk/metadata OK 50s 324ms
/s3/minio/disk/min bytes for seek syntax OK 44s 600ms
/s3/minio/disk/multiple storage OK 52s 722ms
/s3/minio/disk/multiple storage query OK 55s 905ms
/s3/minio/disk/no restart XFail 2ms
/s3/minio/disk/perform ttl move on insert OK 1m 37s
/s3/minio/disk/perform ttl move on insert default OK 53s 859ms
/s3/minio/disk/performance ttl move OK 1m 4s
/s3/minio/disk/remote host filter OK 1m 29s
/s3/minio/disk/specific url Skip 1ms
/s3/minio/disk/syntax OK 50s 555ms
/s3/minio/disk/wide parts OK 44s 730ms
/s3/minio/invalid disk OK 3m 48s
/s3/minio/invalid disk/access default OK 12s 709ms
/s3/minio/invalid disk/access failed OK 11s 715ms
/s3/minio/invalid disk/access failed skip check OK 47s 199ms
/s3/minio/invalid disk/cache path conflict XFail 2ms
/s3/minio/invalid disk/empty endpoint OK 9s 699ms
/s3/minio/invalid disk/invalid endpoint OK 2m 9s
/s3/minio/invalid disk/invalid type OK 17s 263ms
/s3/minio/alter OK 1m 13s
/s3/minio/alter/attach from OK 1s 581ms
/s3/minio/alter/columns OK 1s 621ms
/s3/minio/alter/detach OK 2s 186ms
/s3/minio/alter/drop OK 4s 511ms
/s3/minio/alter/fetch OK 2s 833ms
/s3/minio/alter/freeze OK 1s 298ms
/s3/minio/alter/index OK 6s 4ms
/s3/minio/alter/move to table OK 2s 586ms
/s3/minio/alter/order by OK 570ms
/s3/minio/alter/projection OK 901ms
/s3/minio/alter/replace OK 2s 161ms
/s3/minio/alter/sample by OK 571ms
/s3/minio/alter/update delete OK 897ms
/s3/minio/combinatoric table OK 4m 4s
/s3/minio/combinatoric table/engine=MergeTree,replicated=False,n_cols=500,n_tables=1,part_type=wide OK 7s 406ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=unspecified OK 21s 620ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=wide OK 5s 992ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=False,n_cols=2000,n_tables=3,part_type=unspecified OK 13s 472ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=False,n_cols=10,n_tables=3,part_type=compact OK 1s 75ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=unspecified OK 3s 375ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=compact OK 7s 759ms
/s3/minio/combinatoric table/engine=MergeTree,replicated=True,n_cols=10,n_tables=3,part_type=unspecified OK 17s 438ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 947ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=compact OK 58s 175ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=500,n_tables=1,part_type=unspecified OK 8s 912ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 993ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 989ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=unspecified OK 758ms
/s3/minio/reconnect OK 2m 41s
/s3/minio/reconnect/local and s3 disk OK 54s 449ms
/s3/minio/reconnect/local and s3 volumes OK 54s 719ms
/s3/minio/reconnect/s3 disk OK 52s 771ms
/s3/minio/zero copy replication OK 39m 15s
/s3/minio/zero copy replication/add remove one replica OK 36s 590ms
/s3/minio/zero copy replication/add remove replica parallel OK 45s 424ms
/s3/minio/zero copy replication/add replica global setting OK 1m 23s
/s3/minio/zero copy replication/add replica local setting OK 37s 150ms
/s3/minio/zero copy replication/alter OK 4m 42s
/s3/minio/zero copy replication/bad detached part OK 1m 8s
/s3/minio/zero copy replication/check refcount after mutation OK 1m 11s
/s3/minio/zero copy replication/consistency during conflicting mutation OK 1m 12s
/s3/minio/zero copy replication/consistency during double mutation OK 1m 12s
/s3/minio/zero copy replication/default value OK 13s 357ms
/s3/minio/zero copy replication/delete XFail 10m 36s
/s3/minio/zero copy replication/delete all OK 26s 94ms
/s3/minio/zero copy replication/drop replica OK 41s 894ms
/s3/minio/zero copy replication/global setting OK 1m 9s
/s3/minio/zero copy replication/insert multiple replicas OK 2m 7s
/s3/minio/zero copy replication/metadata OK 1m 9s
/s3/minio/zero copy replication/migration OK 1m 3s
/s3/minio/zero copy replication/offline alter replica OK 41s 196ms
/s3/minio/zero copy replication/performance alter OK 33s 844ms
/s3/minio/zero copy replication/performance insert OK 58s 215ms
/s3/minio/zero copy replication/performance select OK 59s 349ms
/s3/minio/zero copy replication/stale alter replica OK 1m 6s
/s3/minio/zero copy replication/ttl delete OK 1m 57s
/s3/minio/zero copy replication/ttl move OK 1m 56s
/s3/minio/cit OK 929ms
/s3/minio/cit/test empty put OK 215ms
/s3/minio/cit/test put OK 230ms
/s3/minio/cit/test put csv OK 273ms
/s3/minio/cit/test put get with redirect OK 167ms
/s3/minio/settings OK 22m 58s
/s3/minio/settings/setting combinations OK 22m 13s
/s3/minio/table function performance OK 15m 57s
/s3/minio/table function performance/setup OK 13m 9s
/s3/minio/table function performance/wildcard OK 2m 47s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204