Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateSep 19, 2023 8:11
Duration53m 16s
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinitystable/6231175917/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/265/6b52da82b6ca003e8ebd34ead5f4eabbc45d1cd6/package_aarch64/clickhouse-common-static_22.8.15.25.altinitystable_arm64.deb
version22.8.15.25.altinitystable
user.nameMyroTk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc23ebf091e566342377fb79fbd78ac3f7a42e678
job.id6231175917
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/6231175917
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/265/6b52da82b6ca003e8ebd34ead5f4eabbc45d1cd6/package_aarch64/clickhouse-common-static_22.8.15.25.altinitystable_arm64.deb
stressFalse
collect_service_logsTrue
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

79.2%OK
19.3%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
9
9
Features
9
9
Scenarios
141
3
99
39
Examples
42
42
Steps
12678
12672
6

Known Fails

Test NameResultMessage
/s3/minio disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio disk/cache pathXFail 519us
Under development for 22.8 and newer.
None
/s3/minio disk/low cardinality offsetXFail 42s 640ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 486, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 454, in regression
    minio_regression(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 261, in minio_regression
    Feature(test=load("s3.tests.disk", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2787, in minio
    disk_tests()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2742, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2711, in low_cardinality_offset
    assert output == "23999\n", error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2711 in 'low_cardinality_offset'

2703\|                          "1",
2704\|                      ),
2705\|                      (
2706\|                          "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2707\|                          "1",
2708\|                      ),
2709\|                  ],
2710\|              ).output
2711\|>             assert output == "23999\n", error()
2712\|  
2713\|      finally:
2714\|          with Finally(f"I remove the table {name}"):
/s3/minio invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/minio zero copy replication/alterXFail 1m 38s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 486, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 454, in regression
    minio_regression(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 273, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2179, in minio
    outline()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2133, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 863, in alter
    assert False, "data in S3 has grown by more than 50%"
AssertionError: data in S3 has grown by more than 50%
/s3/minio zero copy replication/alter repeatXFail 1m 39s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 486, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 454, in regression
    minio_regression(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 273, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2179, in minio
    outline()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2133, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1025, in alter_repeat
    assert False, "data in S3 has grown by more than 50%"
AssertionError: data in S3 has grown by more than 50%
/s3/minio zero copy replication/deleteXFail 40s 785ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 486, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 454, in regression
    minio_regression(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 273, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2179, in minio
    outline()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 2133, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1314, in delete
    assert size_before >= size - 5, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert size_before >= size - 5, error()

Assertion values
  assert size_before >= size - 5, error()
         ^ is 0
  assert size_before >= size - 5, error()
                        ^ is 6306511
  assert size_before >= size - 5, error()
                             ^ is = 6306506
  assert size_before >= size - 5, error()
                     ^ is = False
  assert size_before >= size - 5, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py', line 1314 in 'delete'

1306\|              ):
1307\|                  size = get_bucket_size(
1308\|                      name=bucket_name,
1309\|                      prefix=bucket_path,
1310\|                      minio_enabled=minio_enabled,
1311\|                      access_key=self.context.secret_access_key,
1312\|                      key_id=self.context.access_key_id,
1313\|                  )
1314\|>                 assert size_before >= size - 5, error()
1315\|                  assert size_before <= size + 5, error()
1316\|  
1317\|          finally:

Results

Test Name Result Duration
/s3 OK 53m 16s
/s3/minio table function OK 1m 23s
/s3/minio table function/auto OK 9s 103ms
/s3/minio table function/compression OK 8s 933ms
/s3/minio table function/credentials OK 978ms
/s3/minio table function/data format OK 9s 552ms
/s3/minio table function/multipart OK 4s 819ms
/s3/minio table function/multiple columns OK 1s 391ms
/s3/minio table function/partition OK 385ms
/s3/minio table function/remote host filter OK 41s 460ms
/s3/minio table function/syntax OK 978ms
/s3/minio table function/wildcard OK 6s 339ms
/s3/minio backup OK 2m 44s
/s3/minio backup/local and s3 disk OK 55s 194ms
/s3/minio backup/local and s3 volumes OK 54s 325ms
/s3/minio backup/s3 disk OK 54s 546ms
/s3/minio invalid table function OK 3s 224ms
/s3/minio invalid table function/empty path OK 394ms
/s3/minio invalid table function/empty structure OK 421ms
/s3/minio invalid table function/invalid compression OK 450ms
/s3/minio invalid table function/invalid credentials OK 421ms
/s3/minio invalid table function/invalid format OK 761ms
/s3/minio invalid table function/invalid path OK 397ms
/s3/minio invalid table function/invalid structure OK 359ms
/s3/minio disk OK 26m 36s
/s3/minio disk/access OK 41s 853ms
/s3/minio disk/access skip check OK 39s 764ms
/s3/minio disk/add storage OK 1m 27s
/s3/minio disk/alter move OK 47s 954ms
/s3/minio disk/alter on cluster modify ttl OK 1m 24s
/s3/minio disk/cache XFail 1ms
/s3/minio disk/cache default XFail 1ms
/s3/minio disk/cache path XFail 519us
/s3/minio disk/compact parts OK 40s 544ms
/s3/minio disk/config over restart OK 56s 158ms
/s3/minio disk/default move factor OK 57s 752ms
/s3/minio disk/delete OK 1m 42s
/s3/minio disk/download appropriate disk OK 1m 8s
/s3/minio disk/environment credentials Skip 2ms
/s3/minio disk/exports OK 42s 620ms
/s3/minio disk/generic url Skip 1ms
/s3/minio disk/imports OK 42s 781ms
/s3/minio disk/low cardinality offset XFail 42s 640ms
/s3/minio disk/max single part upload size syntax OK 40s 837ms
/s3/minio disk/mergetree OK 2m 57s
/s3/minio disk/mergetree collapsing OK 44s 145ms
/s3/minio disk/mergetree versionedcollapsing OK 44s 523ms
/s3/minio disk/metadata OK 44s 34ms
/s3/minio disk/min bytes for seek syntax OK 40s 614ms
/s3/minio disk/multiple storage OK 44s 118ms
/s3/minio disk/multiple storage query OK 44s 589ms
/s3/minio disk/perform ttl move on insert OK 1m 21s
/s3/minio disk/perform ttl move on insert default OK 44s 158ms
/s3/minio disk/performance ttl move OK 56s 327ms
/s3/minio disk/remote host filter OK 1m 21s
/s3/minio disk/restart OK 15s 346ms
/s3/minio disk/specific url Skip 790us
/s3/minio disk/syntax OK 43s 424ms
/s3/minio disk/wide parts OK 40s 992ms
/s3/minio invalid disk OK 1m 58s
/s3/minio invalid disk/access default OK 19s 12ms
/s3/minio invalid disk/access failed OK 18s 842ms
/s3/minio invalid disk/access failed skip check OK 42s 188ms
/s3/minio invalid disk/cache path conflict XFail 1ms
/s3/minio invalid disk/empty endpoint OK 9s 783ms
/s3/minio invalid disk/invalid endpoint OK 9s 856ms
/s3/minio invalid disk/invalid type OK 18s 509ms
/s3/minio sanity OK 48s 220ms
/s3/minio sanity/sanity OK 7s 670ms
/s3/minio reconnect OK 2m 24s
/s3/minio reconnect/local and s3 disk OK 47s 946ms
/s3/minio reconnect/local and s3 volumes OK 48s 433ms
/s3/minio reconnect/s3 disk OK 48s 308ms
/s3/minio zero copy replication OK 14m 51s
/s3/minio zero copy replication/add replica OK 41s 431ms
/s3/minio zero copy replication/alter XFail 1m 38s
/s3/minio zero copy replication/alter repeat XFail 1m 39s
/s3/minio zero copy replication/default value OK 11s 775ms
/s3/minio zero copy replication/delete XFail 40s 785ms
/s3/minio zero copy replication/delete all OK 39s 942ms
/s3/minio zero copy replication/drop alter replica OK 53s 522ms
/s3/minio zero copy replication/drop replica OK 54s 309ms
/s3/minio zero copy replication/global setting OK 40s 361ms
/s3/minio zero copy replication/insert multiple replicas OK 42s 62ms
/s3/minio zero copy replication/lost data during mutation OK 1s 203ms
/s3/minio zero copy replication/metadata OK 40s 820ms
/s3/minio zero copy replication/performance alter OK 1m 7s
/s3/minio zero copy replication/performance insert OK 1m 3s
/s3/minio zero copy replication/performance select OK 1m 7s
/s3/minio zero copy replication/ttl delete OK 40s 957ms
/s3/minio zero copy replication/ttl move OK 43s 176ms
/s3/cit OK 1s 135ms
/s3/cit/test empty put OK 273ms
/s3/cit/test put OK 319ms
/s3/cit/test put csv OK 337ms
/s3/cit/test put get with redirect OK 185ms

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122