Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateNov 04, 2024 21:58
Duration1h 55m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

87.6%OK
11.5%Known

Statistics

Units Skip OK Fail XFail
Modules
2
2
Features
13
13
Scenarios
184
3
143
38
Checks
15
15
Examples
71
70
1
Steps
175476
175453
9
14

Known Fails

Test NameResultMessage
/s3/minio/disk/cacheXFail 974us
Under development for 22.8 and newer.
None
/s3/minio/disk/cache defaultXFail 728us
Under development for 22.8 and newer.
None
/s3/minio/disk/cache pathXFail 756us
Under development for 22.8 and newer.
None
/s3/minio/disk/low cardinality offsetXFail 36s 302ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 323, in minio_regression
    Feature(test=load("s3.tests.disk", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2461, in minio
    disk_tests(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2431, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2394, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2394 in 'low_cardinality_offset'

2386\|                      "1",
2387\|                  ),
2388\|                  (
2389\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2390\|                      "1",
2391\|                  ),
2392\|              ],
2393\|          ).output
2394\|>         assert output == "23999\n", error()
2395\|  
2396\|  
2397\|  @TestFeature
/s3/minio/disk/no restartXFail 1ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/minio/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio/zero copy replication/deleteXFail 10m 32s
test is slow to clean up, needs investigation
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 332, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1720, in minio
    outline(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1692, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 826, in delete
    check_bucket_size(expected_size=size_before, tolerance=5)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 814, in check_bucket_size
    assert abs(current_size - expected_size) <= tolerance, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert abs(current_size - expected_size) <= tolerance, error()

Assertion values
  assert abs(current_size - expected_size) <= tolerance, error()
             ^ is 12038565
  assert abs(current_size - expected_size) <= tolerance, error()
                            ^ is 124060504
  assert abs(current_size - expected_size) <= tolerance, error()
                          ^ is = -112021939
  assert abs(current_size - expected_size) <= tolerance, error()
         ^ is = 112021939
  assert abs(current_size - expected_size) <= tolerance, error()
                                              ^ is 5
  assert abs(current_size - expected_size) <= tolerance, error()
                                           ^ is = False
  assert abs(current_size - expected_size) <= tolerance, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 814 in 'check_bucket_size'

806\|  ):
807\|      current_size = get_bucket_size(
808\|          name=name,
809\|          prefix=prefix,
810\|          minio_enabled=minio_enabled,
811\|          access_key=self.context.secret_access_key,
812\|          key_id=self.context.access_key_id,
813\|      )
814\|>     assert abs(current_size - expected_size) <= tolerance, error()
815\|  
816\|  
817\|  @TestStep(When)

Results

Test Name Result Duration
/s3 OK 1h 55m
/s3/minio OK 1h 55m
/s3/minio/sanity OK 40s 190ms
/s3/minio/sanity/sanity OK 4s 481ms
/s3/minio/table function OK 1m 41s
/s3/minio/table function/auto OK 4s 338ms
/s3/minio/table function/compression OK 4s 317ms
/s3/minio/table function/credentials OK 464ms
/s3/minio/table function/data format OK 5s 576ms
/s3/minio/table function/measure file size OK 42s 145ms
/s3/minio/table function/multipart OK 2s 696ms
/s3/minio/table function/multiple columns OK 689ms
/s3/minio/table function/partition OK 237ms
/s3/minio/table function/remote host filter OK 35s 880ms
/s3/minio/table function/syntax OK 747ms
/s3/minio/table function/wildcard OK 4s 321ms
/s3/minio/backup OK 5m 25s
/s3/minio/backup/local and s3 disk OK 1m 49s
/s3/minio/backup/local and s3 volumes OK 1m 48s
/s3/minio/backup/s3 disk OK 1m 48s
/s3/minio/invalid table function OK 1s 755ms
/s3/minio/invalid table function/empty path OK 214ms
/s3/minio/invalid table function/empty structure OK 198ms
/s3/minio/invalid table function/invalid compression OK 209ms
/s3/minio/invalid table function/invalid credentials OK 300ms
/s3/minio/invalid table function/invalid format OK 430ms
/s3/minio/invalid table function/invalid path OK 200ms
/s3/minio/invalid table function/invalid structure OK 193ms
/s3/minio/disk OK 34m 6s
/s3/minio/disk/access OK 36s 55ms
/s3/minio/disk/access skip check OK 36s 76ms
/s3/minio/disk/add storage OK 1m 12s
/s3/minio/disk/alter move OK 40s 663ms
/s3/minio/disk/alter on cluster modify ttl OK 1m 12s
/s3/minio/disk/cache XFail 974us
/s3/minio/disk/cache default XFail 728us
/s3/minio/disk/cache path XFail 756us
/s3/minio/disk/compact parts OK 35s 951ms
/s3/minio/disk/config over restart OK 48s 276ms
/s3/minio/disk/default move factor OK 42s 483ms
/s3/minio/disk/delete OK 1m 28s
/s3/minio/disk/download appropriate disk OK 1m 0s
/s3/minio/disk/drop sync OK 1m 7s
/s3/minio/disk/environment credentials Skip 1ms
/s3/minio/disk/exports OK 37s 650ms
/s3/minio/disk/generic url Skip 2ms
/s3/minio/disk/imports OK 37s 605ms
/s3/minio/disk/log OK 3m 55s
/s3/minio/disk/low cardinality offset XFail 36s 302ms
/s3/minio/disk/max single part upload size syntax OK 36s 299ms
/s3/minio/disk/mergetree OK 7m 14s
/s3/minio/disk/mergetree collapsing OK 1m 18s
/s3/minio/disk/mergetree versionedcollapsing OK 1m 18s
/s3/minio/disk/metadata OK 38s 319ms
/s3/minio/disk/min bytes for seek syntax OK 36s 568ms
/s3/minio/disk/multiple storage OK 40s 871ms
/s3/minio/disk/multiple storage query OK 40s 181ms
/s3/minio/disk/no restart XFail 1ms
/s3/minio/disk/perform ttl move on insert OK 1m 13s
/s3/minio/disk/perform ttl move on insert default OK 38s 924ms
/s3/minio/disk/performance ttl move OK 54s 569ms
/s3/minio/disk/remote host filter OK 1m 13s
/s3/minio/disk/specific url Skip 676us
/s3/minio/disk/syntax OK 38s 982ms
/s3/minio/disk/wide parts OK 36s 849ms
/s3/minio/invalid disk OK 3m 43s
/s3/minio/invalid disk/access default OK 11s 543ms
/s3/minio/invalid disk/access failed OK 12s 624ms
/s3/minio/invalid disk/access failed skip check OK 40s 297ms
/s3/minio/invalid disk/cache path conflict XFail 1ms
/s3/minio/invalid disk/empty endpoint OK 9s 553ms
/s3/minio/invalid disk/invalid endpoint OK 2m 10s
/s3/minio/invalid disk/invalid type OK 19s 93ms
/s3/minio/alter OK 1m 3s
/s3/minio/alter/attach from OK 1s 419ms
/s3/minio/alter/columns OK 1s 393ms
/s3/minio/alter/detach OK 1s 939ms
/s3/minio/alter/drop OK 4s 14ms
/s3/minio/alter/fetch OK 2s 340ms
/s3/minio/alter/freeze OK 1s 210ms
/s3/minio/alter/index OK 5s 830ms
/s3/minio/alter/move to table OK 2s 550ms
/s3/minio/alter/order by OK 502ms
/s3/minio/alter/projection OK 762ms
/s3/minio/alter/replace OK 2s 614ms
/s3/minio/alter/sample by OK 440ms
/s3/minio/alter/update delete OK 813ms
/s3/minio/combinatoric table OK 3m 16s
/s3/minio/combinatoric table/engine=MergeTree,replicated=False,n_cols=500,n_tables=1,part_type=wide OK 4s 847ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=unspecified OK 18s 465ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=wide OK 5s 728ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=False,n_cols=2000,n_tables=3,part_type=unspecified OK 4s 610ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=False,n_cols=10,n_tables=3,part_type=compact OK 872ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=unspecified OK 671ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=compact OK 4s 817ms
/s3/minio/combinatoric table/engine=MergeTree,replicated=True,n_cols=10,n_tables=3,part_type=unspecified OK 12s 123ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 206ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=compact OK 49s 384ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=500,n_tables=1,part_type=unspecified OK 6s 190ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 374ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 17s 282ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=unspecified OK 628ms
/s3/minio/reconnect OK 2m 9s
/s3/minio/reconnect/local and s3 disk OK 42s 959ms
/s3/minio/reconnect/local and s3 volumes OK 43s 38ms
/s3/minio/reconnect/s3 disk OK 43s 169ms
/s3/minio/zero copy replication OK 35m 53s
/s3/minio/zero copy replication/add remove one replica OK 36s 331ms
/s3/minio/zero copy replication/add remove replica parallel OK 37s 137ms
/s3/minio/zero copy replication/add replica global setting OK 1m 8s
/s3/minio/zero copy replication/add replica local setting OK 33s 41ms
/s3/minio/zero copy replication/alter OK 4m 14s
/s3/minio/zero copy replication/bad detached part OK 56s 733ms
/s3/minio/zero copy replication/check refcount after mutation OK 1m 11s
/s3/minio/zero copy replication/consistency during conflicting mutation OK 1m 12s
/s3/minio/zero copy replication/consistency during double mutation OK 1m 12s
/s3/minio/zero copy replication/default value OK 10s 616ms
/s3/minio/zero copy replication/delete XFail 10m 32s
/s3/minio/zero copy replication/delete all OK 22s 210ms
/s3/minio/zero copy replication/drop replica OK 33s 567ms
/s3/minio/zero copy replication/global setting OK 56s 860ms
/s3/minio/zero copy replication/insert multiple replicas OK 2m 3s
/s3/minio/zero copy replication/metadata OK 57s 580ms
/s3/minio/zero copy replication/migration OK 1m 2s
/s3/minio/zero copy replication/offline alter replica OK 33s 144ms
/s3/minio/zero copy replication/performance alter OK 26s 207ms
/s3/minio/zero copy replication/performance insert OK 45s 72ms
/s3/minio/zero copy replication/performance select OK 45s 856ms
/s3/minio/zero copy replication/stale alter replica OK 1m 2s
/s3/minio/zero copy replication/ttl delete OK 1m 41s
/s3/minio/zero copy replication/ttl move OK 1m 40s
/s3/minio/cit OK 690ms
/s3/minio/cit/test empty put OK 167ms
/s3/minio/cit/test put OK 181ms
/s3/minio/cit/test put csv OK 178ms
/s3/minio/cit/test put get with redirect OK 145ms
/s3/minio/settings OK 11m 17s
/s3/minio/settings/setting combinations OK 10m 39s
/s3/minio/table function performance OK 13m 42s
/s3/minio/table function performance/setup OK 11m 4s
/s3/minio/table function performance/wildcard OK 2m 37s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204