Document status - Confidential


S3 Test Run Report

DateFeb 10, 2023 20:57
Duration30m 34s
Framework TestFlows 1.9.221228.1171522

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850430/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.8.13.21
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3752850430
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850430
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse
stressFalse
storages['gcs']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionNone
aws_s3_key_idNone
aws_s3_access_keyNone
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Tags

altinity-docker-runner

Summary

88.4%OK
5.4%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
6
2
4
Features
6
2
4
Scenarios
65
3
56
6
Examples
34
34
Steps
8230
8228
2

Known Fails

Test NameResultMessage
/s3/gcs disk/cacheXFail 962us
Under development for 22.8 and newer.
None
/s3/gcs disk/cache defaultXFail 491us
Under development for 22.8 and newer.
None
/s3/gcs disk/cache pathXFail 657us
Under development for 22.8 and newer.
None
/s3/gcs disk/low cardinality offsetXFail 37s 861ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 464, in 
    regression()
  File "regression/s3/regression.py", line 454, in regression
    gcs_regression(
  File "regression/s3/regression.py", line 389, in gcs_regression
    Feature(test=load("s3.tests.disk", "gcs"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/s3/../s3/tests/disk.py", line 2774, in gcs
    disk_tests()
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/s3/../s3/tests/disk.py", line 2742, in disk_tests
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/s3/../s3/tests/disk.py", line 2711, in low_cardinality_offset
    assert output == "23999\n", error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/s3/../s3/tests/disk.py', line 2711 in 'low_cardinality_offset'

2703\|                          "1",
2704\|                      ),
2705\|                      (
2706\|                          "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2707\|                          "1",
2708\|                      ),
2709\|                  ],
2710\|              ).output
2711\|>             assert output == "23999\n", error()
2712\|  
2713\|      finally:
2714\|          with Finally(f"I remove the table {name}"):
/s3/gcs invalid disk/cache path conflictXFail 840us
Under development for 22.8 and newer.
None

Results

Test Name Result Duration
/s3 OK 30m 34s
/s3/gcs table function OK 1m 12s
/s3/gcs table function/auto OK 7s 99ms
/s3/gcs table function/compression OK 7s 1ms
/s3/gcs table function/credentials OK 743ms
/s3/gcs table function/data format OK 7s 138ms
/s3/gcs table function/multipart OK 3s 190ms
/s3/gcs table function/multiple columns OK 910ms
/s3/gcs table function/partition OK 960ms
/s3/gcs table function/remote host filter OK 35s 480ms
/s3/gcs table function/syntax OK 923ms
/s3/gcs table function/wildcard OK 9s 335ms
/s3/gcs invalid table function OK 1s 359ms
/s3/gcs invalid table function/empty path OK 158ms
/s3/gcs invalid table function/empty structure OK 150ms
/s3/gcs invalid table function/invalid compression OK 149ms
/s3/gcs invalid table function/invalid credentials OK 287ms
/s3/gcs invalid table function/invalid format OK 291ms
/s3/gcs invalid table function/invalid path OK 156ms
/s3/gcs invalid table function/invalid structure OK 155ms
/s3/gcs disk OK 26m 0s
/s3/gcs disk/access OK 38s 613ms
/s3/gcs disk/access skip check OK 38s 555ms
/s3/gcs disk/add storage OK 1m 17s
/s3/gcs disk/alter move OK 47s 974ms
/s3/gcs disk/alter on cluster modify ttl OK 1m 19s
/s3/gcs disk/cache XFail 962us
/s3/gcs disk/cache default XFail 491us
/s3/gcs disk/cache path XFail 657us
/s3/gcs disk/compact parts OK 38s 568ms
/s3/gcs disk/config over restart OK 58s 618ms
/s3/gcs disk/default move factor OK 54s 641ms
/s3/gcs disk/delete OK 2m 21s
/s3/gcs disk/download appropriate disk OK 1m 2s
/s3/gcs disk/environment credentials Skip 817us
/s3/gcs disk/exports OK 39s 281ms
/s3/gcs disk/generic url Skip 731us
/s3/gcs disk/imports OK 38s 76ms
/s3/gcs disk/low cardinality offset XFail 37s 861ms
/s3/gcs disk/max single part upload size syntax OK 38s 743ms
/s3/gcs disk/mergetree OK 2m 51s
/s3/gcs disk/mergetree collapsing OK 40s 193ms
/s3/gcs disk/mergetree versionedcollapsing OK 42s 222ms
/s3/gcs disk/metadata OK 44s 636ms
/s3/gcs disk/min bytes for seek syntax OK 40s 463ms
/s3/gcs disk/multiple storage OK 43s 869ms
/s3/gcs disk/multiple storage query OK 43s 39ms
/s3/gcs disk/perform ttl move on insert OK 1m 15s
/s3/gcs disk/perform ttl move on insert default OK 43s 0ms
/s3/gcs disk/performance ttl move OK 53s 889ms
/s3/gcs disk/remote host filter OK 1m 17s
/s3/gcs disk/restart OK 11s 877ms
/s3/gcs disk/specific url Skip 526us
/s3/gcs disk/syntax OK 40s 473ms
/s3/gcs disk/wide parts OK 39s 721ms
/s3/gcs zero copy replication Skip 1ms
/s3/gcs invalid disk OK 1m 50s
/s3/gcs invalid disk/access default OK 17s 416ms
/s3/gcs invalid disk/access failed OK 18s 458ms
/s3/gcs invalid disk/access failed skip check OK 38s 316ms
/s3/gcs invalid disk/cache path conflict XFail 840us
/s3/gcs invalid disk/empty endpoint OK 8s 372ms
/s3/gcs invalid disk/invalid endpoint OK 9s 388ms
/s3/gcs invalid disk/invalid type OK 18s 769ms
/s3/gcs backup Skip 1ms

Generated by TestFlows Open-Source Test Framework v1.9.221228.1171522