Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateJul 22, 2024 9:22
Duration2h 23m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

87.6%OK
11.5%Known

Statistics

Units Skip OK Fail Error XFail
Modules
2
2
Features
13
13
Scenarios
184
3
143
38
Checks
15
15
Examples
71
70
1
Steps
175317
175288
9
6
14

Known Fails

Test NameResultMessage
/s3/minio/disk/cacheXFail 2ms
Under development for 22.8 and newer.
None
/s3/minio/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio/disk/cache pathXFail 857us
Under development for 22.8 and newer.
None
/s3/minio/disk/low cardinality offsetXFail 47s 852ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 323, in minio_regression
    Feature(test=load("s3.tests.disk", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2461, in minio
    disk_tests(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2431, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2394, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2394 in 'low_cardinality_offset'

2386\|                      "1",
2387\|                  ),
2388\|                  (
2389\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2390\|                      "1",
2391\|                  ),
2392\|              ],
2393\|          ).output
2394\|>         assert output == "23999\n", error()
2395\|  
2396\|  
2397\|  @TestFeature
/s3/minio/disk/no restartXFail 1ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/minio/invalid disk/cache path conflictXFail 2ms
Under development for 22.8 and newer.
None
/s3/minio/zero copy replication/deleteXFail 10m 36s
test is slow to clean up, needs investigation
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 553, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 545, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 332, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1720, in minio
    outline(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1692, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 826, in delete
    check_bucket_size(expected_size=size_before, tolerance=5)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 814, in check_bucket_size
    assert abs(current_size - expected_size) <= tolerance, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert abs(current_size - expected_size) <= tolerance, error()

Assertion values
  assert abs(current_size - expected_size) <= tolerance, error()
             ^ is 9543836
  assert abs(current_size - expected_size) <= tolerance, error()
                            ^ is 122586084
  assert abs(current_size - expected_size) <= tolerance, error()
                          ^ is = -113042248
  assert abs(current_size - expected_size) <= tolerance, error()
         ^ is = 113042248
  assert abs(current_size - expected_size) <= tolerance, error()
                                              ^ is 5
  assert abs(current_size - expected_size) <= tolerance, error()
                                           ^ is = False
  assert abs(current_size - expected_size) <= tolerance, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 814 in 'check_bucket_size'

806\|  ):
807\|      current_size = get_bucket_size(
808\|          name=name,
809\|          prefix=prefix,
810\|          minio_enabled=minio_enabled,
811\|          access_key=self.context.secret_access_key,
812\|          key_id=self.context.access_key_id,
813\|      )
814\|>     assert abs(current_size - expected_size) <= tolerance, error()
815\|  
816\|  
817\|  @TestStep(When)

Results

Test Name Result Duration
/s3 OK 2h 23m
/s3/minio OK 2h 23m
/s3/minio/sanity OK 59s 193ms
/s3/minio/sanity/sanity OK 12s 740ms
/s3/minio/table function OK 2m 11s
/s3/minio/table function/auto OK 5s 757ms
/s3/minio/table function/compression OK 5s 706ms
/s3/minio/table function/credentials OK 658ms
/s3/minio/table function/data format OK 13s 522ms
/s3/minio/table function/measure file size OK 46s 116ms
/s3/minio/table function/multipart OK 6s 723ms
/s3/minio/table function/multiple columns OK 893ms
/s3/minio/table function/partition OK 337ms
/s3/minio/table function/remote host filter OK 44s 606ms
/s3/minio/table function/syntax OK 1s 1ms
/s3/minio/table function/wildcard OK 5s 755ms
/s3/minio/backup OK 5m 53s
/s3/minio/backup/local and s3 disk OK 1m 57s
/s3/minio/backup/local and s3 volumes OK 1m 58s
/s3/minio/backup/s3 disk OK 1m 57s
/s3/minio/invalid table function OK 2s 264ms
/s3/minio/invalid table function/empty path OK 266ms
/s3/minio/invalid table function/empty structure OK 248ms
/s3/minio/invalid table function/invalid compression OK 266ms
/s3/minio/invalid table function/invalid credentials OK 395ms
/s3/minio/invalid table function/invalid format OK 547ms
/s3/minio/invalid table function/invalid path OK 270ms
/s3/minio/invalid table function/invalid structure OK 254ms
/s3/minio/disk OK 41m 57s
/s3/minio/disk/access OK 44s 294ms
/s3/minio/disk/access skip check OK 44s 423ms
/s3/minio/disk/add storage OK 1m 34s
/s3/minio/disk/alter move OK 50s 392ms
/s3/minio/disk/alter on cluster modify ttl OK 1m 32s
/s3/minio/disk/cache XFail 2ms
/s3/minio/disk/cache default XFail 1ms
/s3/minio/disk/cache path XFail 857us
/s3/minio/disk/compact parts OK 44s 560ms
/s3/minio/disk/config over restart OK 1m 3s
/s3/minio/disk/default move factor OK 1m 14s
/s3/minio/disk/delete OK 1m 52s
/s3/minio/disk/download appropriate disk OK 1m 17s
/s3/minio/disk/drop sync OK 1m 21s
/s3/minio/disk/environment credentials Skip 2ms
/s3/minio/disk/exports OK 45s 707ms
/s3/minio/disk/generic url Skip 1ms
/s3/minio/disk/imports OK 48s 514ms
/s3/minio/disk/log OK 4m 41s
/s3/minio/disk/low cardinality offset XFail 47s 852ms
/s3/minio/disk/max single part upload size syntax OK 46s 817ms
/s3/minio/disk/mergetree OK 8m 7s
/s3/minio/disk/mergetree collapsing OK 1m 31s
/s3/minio/disk/mergetree versionedcollapsing OK 1m 32s
/s3/minio/disk/metadata OK 50s 591ms
/s3/minio/disk/min bytes for seek syntax OK 44s 632ms
/s3/minio/disk/multiple storage OK 51s 847ms
/s3/minio/disk/multiple storage query OK 52s 487ms
/s3/minio/disk/no restart XFail 1ms
/s3/minio/disk/perform ttl move on insert OK 1m 30s
/s3/minio/disk/perform ttl move on insert default OK 53s 843ms
/s3/minio/disk/performance ttl move OK 1m 3s
/s3/minio/disk/remote host filter OK 1m 28s
/s3/minio/disk/specific url Skip 5ms
/s3/minio/disk/syntax OK 50s 268ms
/s3/minio/disk/wide parts OK 47s 558ms
/s3/minio/invalid disk OK 3m 48s
/s3/minio/invalid disk/access default OK 12s 725ms
/s3/minio/invalid disk/access failed OK 11s 671ms
/s3/minio/invalid disk/access failed skip check OK 47s 472ms
/s3/minio/invalid disk/cache path conflict XFail 2ms
/s3/minio/invalid disk/empty endpoint OK 9s 718ms
/s3/minio/invalid disk/invalid endpoint OK 2m 9s
/s3/minio/invalid disk/invalid type OK 17s 315ms
/s3/minio/alter OK 1m 15s
/s3/minio/alter/attach from OK 1s 597ms
/s3/minio/alter/columns OK 1s 625ms
/s3/minio/alter/detach OK 2s 245ms
/s3/minio/alter/drop OK 4s 822ms
/s3/minio/alter/fetch OK 2s 987ms
/s3/minio/alter/freeze OK 1s 238ms
/s3/minio/alter/index OK 6s 30ms
/s3/minio/alter/move to table OK 2s 741ms
/s3/minio/alter/order by OK 573ms
/s3/minio/alter/projection OK 948ms
/s3/minio/alter/replace OK 2s 484ms
/s3/minio/alter/sample by OK 571ms
/s3/minio/alter/update delete OK 842ms
/s3/minio/combinatoric table OK 4m 8s
/s3/minio/combinatoric table/engine=MergeTree,replicated=False,n_cols=500,n_tables=1,part_type=wide OK 7s 879ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=unspecified OK 26s 825ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=wide OK 5s 972ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=False,n_cols=2000,n_tables=3,part_type=unspecified OK 13s 391ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=False,n_cols=10,n_tables=3,part_type=compact OK 1s 126ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=unspecified OK 3s 394ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=compact OK 7s 921ms
/s3/minio/combinatoric table/engine=MergeTree,replicated=True,n_cols=10,n_tables=3,part_type=unspecified OK 12s 779ms
/s3/minio/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 18s 148ms
/s3/minio/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=compact OK 59s 559ms
/s3/minio/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=500,n_tables=1,part_type=unspecified OK 8s 947ms
/s3/minio/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 18s 6ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 18s 21ms
/s3/minio/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=unspecified OK 719ms
/s3/minio/reconnect OK 2m 44s
/s3/minio/reconnect/local and s3 disk OK 54s 608ms
/s3/minio/reconnect/local and s3 volumes OK 54s 846ms
/s3/minio/reconnect/s3 disk OK 54s 990ms
/s3/minio/zero copy replication OK 39m 1s
/s3/minio/zero copy replication/add remove one replica OK 36s 621ms
/s3/minio/zero copy replication/add remove replica parallel OK 46s 700ms
/s3/minio/zero copy replication/add replica global setting OK 1m 22s
/s3/minio/zero copy replication/add replica local setting OK 37s 190ms
/s3/minio/zero copy replication/alter OK 4m 28s
/s3/minio/zero copy replication/bad detached part OK 1m 5s
/s3/minio/zero copy replication/check refcount after mutation OK 1m 11s
/s3/minio/zero copy replication/consistency during conflicting mutation OK 1m 12s
/s3/minio/zero copy replication/consistency during double mutation OK 1m 12s
/s3/minio/zero copy replication/default value OK 13s 367ms
/s3/minio/zero copy replication/delete XFail 10m 36s
/s3/minio/zero copy replication/delete all OK 26s 98ms
/s3/minio/zero copy replication/drop replica OK 41s 769ms
/s3/minio/zero copy replication/global setting OK 1m 9s
/s3/minio/zero copy replication/insert multiple replicas OK 2m 7s
/s3/minio/zero copy replication/metadata OK 1m 9s
/s3/minio/zero copy replication/migration OK 1m 3s
/s3/minio/zero copy replication/offline alter replica OK 41s 265ms
/s3/minio/zero copy replication/performance alter OK 33s 859ms
/s3/minio/zero copy replication/performance insert OK 58s 314ms
/s3/minio/zero copy replication/performance select OK 59s 7ms
/s3/minio/zero copy replication/stale alter replica OK 1m 6s
/s3/minio/zero copy replication/ttl delete OK 1m 58s
/s3/minio/zero copy replication/ttl move OK 1m 57s
/s3/minio/cit OK 870ms
/s3/minio/cit/test empty put OK 216ms
/s3/minio/cit/test put OK 229ms
/s3/minio/cit/test put csv OK 236ms
/s3/minio/cit/test put get with redirect OK 160ms
/s3/minio/settings OK 21m 47s
/s3/minio/settings/setting combinations OK 21m 1s
/s3/minio/table function performance OK 16m 10s
/s3/minio/table function performance/setup OK 12m 51s
/s3/minio/table function performance/wildcard OK 3m 19s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204