Document status - Confidential

Copyright 2022, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateSep 19, 2022 14:21
Duration2h 57m
Framework TestFlows 1.9.220810.1192506

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3048291319/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameVitaliy Zakaznikov
user.emailvzakaznikov@protonmail.com
version22.3.10.24
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3048291319
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3048291319
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse
stressFalse
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionNone
aws_s3_key_idNone
aws_s3_access_keyNone
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Tags

altinity-docker-runner

Summary

93.1%OK
3.4%Known
2%Fail

Statistics

Units Skip OK Fail Error XFail XError
Modules
1
1
Suites
9
8
1
Features
9
8
1
Scenarios
140
3
129
1
6
1
Examples
44
44
Steps
16047
16017
25
5

Fails

Test NameResultMessage
/s3Fail 2h 57m
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.10):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_d39a32c4_3823_11ed_8707_0242ac110005 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_d39a32c4_3823_11ed_8707_0242ac110005', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replicationFail 2h 11m
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.10):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_d39a32c4_3823_11ed_8707_0242ac110005 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_d39a32c4_3823_11ed_8707_0242ac110005', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/lost data during mutationFail 24m 34s
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.10):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_d39a32c4_3823_11ed_8707_0242ac110005 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.10.24.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_d39a32c4_3823_11ed_8707_0242ac110005 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_d39a32c4_3823_11ed_8707_0242ac110005', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|

Known Fails

Test NameResultMessage
/s3/minio zero copy replication/alterXFail 25m 50s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 823, in alter
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.10):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (7c8e351b-f94e-42fb-9c3a-1ff1d6ad6589): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/alter repeatXFail 25m 51s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1003, in alter_repeat
    alter_table(s)
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 921, in alter_table
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.10):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (47605c4c-e17f-4d26-bb18-c29c4e811984): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/deleteXFail 35s 713ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1312, in delete
    assert size_before >= size - 5, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert size_before >= size - 5, error()

Assertion values
  assert size_before >= size - 5, error()
         ^ is 0
  assert size_before >= size - 5, error()
                        ^ is 6306511
  assert size_before >= size - 5, error()
                             ^ is = 6306506
  assert size_before >= size - 5, error()
                     ^ is = False
  assert size_before >= size - 5, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py', line 1312 in 'delete'

1304\|              ):
1305\|                  size = get_bucket_size(
1306\|                      name=bucket_name,
1307\|                      prefix=bucket_path,
1308\|                      minio_enabled=minio_enabled,
1309\|                      access_key=self.context.secret_access_key,
1310\|                      key_id=self.context.access_key_id,
1311\|                  )
1312\|>                 assert size_before >= size - 5, error()
1313\|                  assert size_before <= size + 5, error()
1314\|  
1315\|          finally:
/s3/minio zero copy replication/performance alterXFail 30m 33s
Unstable test
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1967, in performance_alter
    nodes[1].query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.10):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (a90dcdcf-7d21-435a-a454-eaec3a2bc188): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/performance selectXError 15m 34s
Unstable test
ExpectTimeoutError
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
  File "/usr/lib/python3.8/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.032s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1847, in performance_select
    nodes[1].query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 612, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 300.000s for '(bash# )\|(\n)'
/s3/minio zero copy replication/ttl deleteXFail 42s 325ms
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1653, in ttl_delete
    check_query_node(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py", line 696, in check_query_node
    assert r == expected, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py', line 696 in 'check_query_node'

688\|  
689\|  @TestStep(Then)
690\|  def check_query_node(self, node, num, query, expected):
691\|      node = current().context.node
692\|  
693\|      with By(f"executing query {num}", description=query):
694\|          r = node.query(query).output.strip()
695\|          with Then(f"result should match the expected", description=expected):
696\|>             assert r == expected, error()
697\|  
698\|  
699\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 Fail 2h 57m
/s3/minio table function OK 58s 894ms
/s3/minio table function/auto OK 4s 255ms
/s3/minio table function/compression OK 4s 434ms
/s3/minio table function/credentials OK 507ms
/s3/minio table function/data format OK 4s 948ms
/s3/minio table function/multipart OK 2s 547ms
/s3/minio table function/multiple columns OK 693ms
/s3/minio table function/partition OK 182ms
/s3/minio table function/remote host filter OK 37s 668ms
/s3/minio table function/syntax OK 476ms
/s3/minio table function/wildcard OK 3s 169ms
/s3/minio backup OK 10m 18s
/s3/minio backup/local and s3 disk OK 3m 25s
/s3/minio backup/local and s3 volumes OK 3m 26s
/s3/minio backup/s3 disk OK 3m 26s
/s3/minio invalid table function OK 1s 408ms
/s3/minio invalid table function/empty path OK 163ms
/s3/minio invalid table function/empty structure OK 166ms
/s3/minio invalid table function/invalid compression OK 164ms
/s3/minio invalid table function/invalid credentials OK 185ms
/s3/minio invalid table function/invalid format OK 359ms
/s3/minio invalid table function/invalid path OK 164ms
/s3/minio invalid table function/invalid structure OK 197ms
/s3/minio disk OK 26m 5s
/s3/minio disk/access OK 37s 716ms
/s3/minio disk/access skip check OK 37s 863ms
/s3/minio disk/add storage OK 1m 12s
/s3/minio disk/alter move OK 43s 73ms
/s3/minio disk/alter on cluster modify ttl OK 1m 14s
/s3/minio disk/cache OK 1m 24s
/s3/minio disk/cache default OK 42s 641ms
/s3/minio disk/cache path OK 42s 551ms
/s3/minio disk/compact parts OK 39s 974ms
/s3/minio disk/config over restart OK 49s 252ms
/s3/minio disk/default move factor OK 48s 187ms
/s3/minio disk/delete OK 1m 30s
/s3/minio disk/download appropriate disk OK 1m 2s
/s3/minio disk/environment credentials Skip 669us
/s3/minio disk/exports OK 38s 438ms
/s3/minio disk/generic url Skip 600us
/s3/minio disk/imports OK 36s 268ms
/s3/minio disk/max single part upload size syntax OK 36s 300ms
/s3/minio disk/mergetree OK 2m 41s
/s3/minio disk/mergetree collapsing OK 39s 840ms
/s3/minio disk/mergetree versionedcollapsing OK 40s 164ms
/s3/minio disk/metadata OK 39s 793ms
/s3/minio disk/min bytes for seek syntax OK 38s 112ms
/s3/minio disk/multiple storage OK 41s 803ms
/s3/minio disk/multiple storage query OK 41s 849ms
/s3/minio disk/perform ttl move on insert OK 1m 15s
/s3/minio disk/perform ttl move on insert default OK 42s 817ms
/s3/minio disk/performance ttl move OK 46s 524ms
/s3/minio disk/remote host filter OK 1m 13s
/s3/minio disk/restart OK 11s 220ms
/s3/minio disk/specific url Skip 740us
/s3/minio disk/syntax OK 40s 54ms
/s3/minio disk/wide parts OK 35s 171ms
/s3/minio invalid disk OK 1m 55s
/s3/minio invalid disk/access default OK 15s 431ms
/s3/minio invalid disk/access failed OK 15s 469ms
/s3/minio invalid disk/access failed skip check OK 37s 564ms
/s3/minio invalid disk/cache path conflict OK 9s 409ms
/s3/minio invalid disk/empty endpoint OK 9s 431ms
/s3/minio invalid disk/invalid endpoint OK 9s 396ms
/s3/minio invalid disk/invalid type OK 18s 840ms
/s3/minio sanity OK 42s 261ms
/s3/minio sanity/sanity OK 4s 325ms
/s3/minio reconnect OK 2m 34s
/s3/minio reconnect/local and s3 disk OK 44s 843ms
/s3/minio reconnect/local and s3 volumes OK 56s 766ms
/s3/minio reconnect/s3 disk OK 53s 8ms
/s3/minio zero copy replication Fail 2h 11m
/s3/minio zero copy replication/add replica OK 35s 363ms
/s3/minio zero copy replication/alter XFail 25m 50s
/s3/minio zero copy replication/alter repeat XFail 25m 51s
/s3/minio zero copy replication/default value OK 10s 717ms
/s3/minio zero copy replication/delete XFail 35s 713ms
/s3/minio zero copy replication/delete all OK 37s 847ms
/s3/minio zero copy replication/drop alter replica OK 52s 256ms
/s3/minio zero copy replication/drop replica OK 47s 435ms
/s3/minio zero copy replication/global setting OK 38s 158ms
/s3/minio zero copy replication/insert multiple replicas OK 38s 238ms
/s3/minio zero copy replication/lost data during mutation Fail 24m 34s
/s3/minio zero copy replication/metadata OK 37s 405ms
/s3/minio zero copy replication/performance alter XFail 30m 33s
/s3/minio zero copy replication/performance insert OK 1m 6s
/s3/minio zero copy replication/performance select XError 15m 34s
/s3/minio zero copy replication/ttl delete XFail 42s 325ms
/s3/minio zero copy replication/ttl move OK 39s 996ms
/s3/cit OK 625ms
/s3/cit/test empty put OK 131ms
/s3/cit/test put OK 145ms
/s3/cit/test put csv OK 226ms
/s3/cit/test put get with redirect OK 95ms

Generated by TestFlows Open-Source Test Framework v1.9.220810.1192506