Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateApr 28, 2024 17:01
Duration34m 10s
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_release/clickhouse-common-static_23.8.11.29.altinitystable_amd64.deb
version23.8.11.29.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash17a81c07fc1f41fbee651e0ef0ca4b44e537e5b1
job.id8868426423
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8868426423
archx86_64
allow_experimental_analyzerFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_release/clickhouse-common-static_23.8.11.29.altinitystable_amd64.deb
stressFalse
allow_vfsFalse
collect_service_logsTrue
storages['gcs']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

90%OK
5.5%Known

Statistics

Units Skip OK Fail XFail
Modules
3
3
Features
6
2
4
Scenarios
65
3
56
6
Checks
2
2
Examples
34
34
Steps
8662
8660
2

Known Fails

Test NameResultMessage
/s3/gcs/normal/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/gcs/normal/disk/cache defaultXFail 564us
Under development for 22.8 and newer.
None
/s3/gcs/normal/disk/cache pathXFail 738us
Under development for 22.8 and newer.
None
/s3/gcs/normal/disk/low cardinality offsetXFail 38s 26ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 513, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 504, in regression
    Module(test=storage_module)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 422, in gcs_regression
    Feature(test=load("s3.tests.disk", "gcs"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2412, in gcs
    disk_tests()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2380, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2353, in low_cardinality_offset
    assert output == "23999\n", error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2353 in 'low_cardinality_offset'

2345\|                      "1",
2346\|                  ),
2347\|                  (
2348\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2349\|                      "1",
2350\|                  ),
2351\|              ],
2352\|          ).output
2353\|>         assert output == "23999\n", error()
2354\|  
2355\|  
2356\|  @TestFeature
/s3/gcs/normal/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None

Results

Test Name Result Duration
/s3 OK 34m 10s
/s3/gcs OK 34m 10s
/s3/gcs/normal OK 32m 55s
/s3/gcs/normal/table function OK 1m 18s
/s3/gcs/normal/table function/auto OK 7s 128ms
/s3/gcs/normal/table function/compression OK 8s 6ms
/s3/gcs/normal/table function/credentials OK 782ms
/s3/gcs/normal/table function/data format OK 6s 383ms
/s3/gcs/normal/table function/multipart OK 3s 725ms
/s3/gcs/normal/table function/multiple columns OK 979ms
/s3/gcs/normal/table function/partition OK 1s 126ms
/s3/gcs/normal/table function/remote host filter OK 35s 46ms
/s3/gcs/normal/table function/syntax OK 1s 327ms
/s3/gcs/normal/table function/wildcard OK 13s 881ms
/s3/gcs/normal/invalid table function OK 1s 448ms
/s3/gcs/normal/invalid table function/empty path OK 154ms
/s3/gcs/normal/invalid table function/empty structure OK 152ms
/s3/gcs/normal/invalid table function/invalid compression OK 165ms
/s3/gcs/normal/invalid table function/invalid credentials OK 331ms
/s3/gcs/normal/invalid table function/invalid format OK 334ms
/s3/gcs/normal/invalid table function/invalid path OK 149ms
/s3/gcs/normal/invalid table function/invalid structure OK 151ms
/s3/gcs/normal/disk OK 27m 47s
/s3/gcs/normal/disk/access OK 37s 351ms
/s3/gcs/normal/disk/access skip check OK 39s 462ms
/s3/gcs/normal/disk/add storage OK 1m 13s
/s3/gcs/normal/disk/alter move OK 46s 300ms
/s3/gcs/normal/disk/alter on cluster modify ttl OK 1m 28s
/s3/gcs/normal/disk/cache XFail 1ms
/s3/gcs/normal/disk/cache default XFail 564us
/s3/gcs/normal/disk/cache path XFail 738us
/s3/gcs/normal/disk/compact parts OK 37s 634ms
/s3/gcs/normal/disk/config over restart OK 1m 10s
/s3/gcs/normal/disk/default move factor OK 48s 227ms
/s3/gcs/normal/disk/delete OK 3m 37s
/s3/gcs/normal/disk/download appropriate disk OK 1m 5s
/s3/gcs/normal/disk/environment credentials Skip 997us
/s3/gcs/normal/disk/exports OK 39s 660ms
/s3/gcs/normal/disk/generic url Skip 805us
/s3/gcs/normal/disk/imports OK 41s 370ms
/s3/gcs/normal/disk/low cardinality offset XFail 38s 26ms
/s3/gcs/normal/disk/max single part upload size syntax OK 42s 405ms
/s3/gcs/normal/disk/mergetree OK 2m 59s
/s3/gcs/normal/disk/mergetree collapsing OK 45s 830ms
/s3/gcs/normal/disk/mergetree versionedcollapsing OK 44s 377ms
/s3/gcs/normal/disk/metadata OK 39s 852ms
/s3/gcs/normal/disk/min bytes for seek syntax OK 37s 469ms
/s3/gcs/normal/disk/multiple storage OK 46s 553ms
/s3/gcs/normal/disk/multiple storage query OK 44s 333ms
/s3/gcs/normal/disk/no restart OK 12s 433ms
/s3/gcs/normal/disk/perform ttl move on insert OK 1m 11s
/s3/gcs/normal/disk/perform ttl move on insert default OK 42s 327ms
/s3/gcs/normal/disk/performance ttl move OK 59s 487ms
/s3/gcs/normal/disk/remote host filter OK 1m 14s
/s3/gcs/normal/disk/specific url Skip 769us
/s3/gcs/normal/disk/syntax OK 46s 124ms
/s3/gcs/normal/disk/wide parts OK 36s 452ms
/s3/gcs/normal/zero copy replication Skip 823us
/s3/gcs/normal/invalid disk OK 3m 47s
/s3/gcs/normal/invalid disk/access default OK 17s 522ms
/s3/gcs/normal/invalid disk/access failed OK 18s 533ms
/s3/gcs/normal/invalid disk/access failed skip check OK 36s 75ms
/s3/gcs/normal/invalid disk/cache path conflict XFail 1ms
/s3/gcs/normal/invalid disk/empty endpoint OK 9s 515ms
/s3/gcs/normal/invalid disk/invalid endpoint OK 2m 7s
/s3/gcs/normal/invalid disk/invalid type OK 18s 958ms
/s3/gcs/normal/backup Skip 895us

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232