Document status - Confidential


S3 Test Run Report

DateOct 04, 2022 18:20
Duration2h 59m
Framework TestFlows 1.9.220810.1192506

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3125479627/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.3.12.20
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3125479627
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3125479627
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse
stressFalse
storages['minio']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionNone
aws_s3_key_idNone
aws_s3_access_keyNone
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Tags

altinity-docker-runner

Summary

93.1%OK
3.4%Known
2%Fail

Statistics

Units Skip OK Fail Error XFail XError
Modules
1
1
Suites
9
8
1
Features
9
8
1
Scenarios
140
3
129
1
6
1
Examples
44
44
Steps
16042
16012
26
4

Fails

Test NameResultMessage
/s3Fail 2h 59m
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.12):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_184d2254_440f_11ed_8173_0242ac110003 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_184d2254_440f_11ed_8173_0242ac110003', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replicationFail 2h 11m
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.12):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_184d2254_440f_11ed_8173_0242ac110003 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_184d2254_440f_11ed_8173_0242ac110003', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/lost data during mutationFail 24m 31s
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2050, in lost_data_during_mutation
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 620, in query
    return self.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Clickhouse1   9000    57  Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build))   2   0
Received exception from server (version 22.3.12):
Code: 57. DB::Exception: Received from localhost:9000. DB::Exception: There was an error on [clickhouse1:9000]: Code: 57. DB::Exception: Table default.table_184d2254_440f_11ed_8173_0242ac110003 already exists. (TABLE_ALREADY_EXISTS) (version 22.3.12.20.altinitystable (altinity build)). (TABLE_ALREADY_EXISTS)
(query: create table table_184d2254_440f_11ed_8173_0242ac110003 on cluster 'sharded_cluster' (key UInt32, value1 String, value2 String, value3 String) engine=ReplicatedMergeTree('/table_184d2254_440f_11ed_8173_0242ac110003', '{replica}')
            order by key
            partition by (key % 4)
            settings storage_policy='external'

)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|

Known Fails

Test NameResultMessage
/s3/minio zero copy replication/alterXFail 25m 57s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 823, in alter
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.12):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (09ee2b75-3338-47ad-9bac-58788b003750): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/alter repeatXFail 25m 52s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1003, in alter_repeat
    alter_table(s)
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 921, in alter_table
    node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.12):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (e4d5f4c5-ef35-422b-83dd-8aa5746037b2): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/deleteXFail 39s 401ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1312, in delete
    assert size_before >= size - 5, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert size_before >= size - 5, error()

Assertion values
  assert size_before >= size - 5, error()
         ^ is 0
  assert size_before >= size - 5, error()
                        ^ is 6306511
  assert size_before >= size - 5, error()
                             ^ is = 6306506
  assert size_before >= size - 5, error()
                     ^ is = False
  assert size_before >= size - 5, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py', line 1312 in 'delete'

1304\|              ):
1305\|                  size = get_bucket_size(
1306\|                      name=bucket_name,
1307\|                      prefix=bucket_path,
1308\|                      minio_enabled=minio_enabled,
1309\|                      access_key=self.context.secret_access_key,
1310\|                      key_id=self.context.access_key_id,
1311\|                  )
1312\|>                 assert size_before >= size - 5, error()
1313\|                  assert size_before <= size + 5, error()
1314\|  
1315\|          finally:
/s3/minio zero copy replication/performance alterXFail 30m 29s
Unstable test
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1967, in performance_alter
    nodes[1].query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.12):
Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: SYNC REPLICA default.zero_copy_replication (ce873d5e-7257-461b-ae59-4764d72e6c36): command timed out. See the 'receive_timeout' setting. (TIMEOUT_EXCEEDED)
(query: SYSTEM SYNC REPLICA zero_copy_replication
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/s3/minio zero copy replication/performance selectXError 15m 37s
Unstable test
ExpectTimeoutError
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
  File "/usr/lib/python3.8/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
  File "/usr/local/lib/python3.8/dist-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.049s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1847, in performance_select
    nodes[1].query(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../helpers/cluster.py", line 612, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 300.000s for '(bash# )\|(\n)'
/s3/minio zero copy replication/ttl deleteXFail 40s 715ms
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 451, in 
    regression()
  File "regression/s3/regression.py", line 422, in regression
    minio_regression(
  File "regression/s3/regression.py", line 253, in minio_regression
    Feature(test=load("s3.tests.zero_copy_replication", "minio"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2176, in minio
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2130, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1653, in ttl_delete
    check_query_node(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py", line 696, in check_query_node
    assert r == expected, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py', line 696 in 'check_query_node'

688\|  
689\|  @TestStep(Then)
690\|  def check_query_node(self, node, num, query, expected):
691\|      node = current().context.node
692\|  
693\|      with By(f"executing query {num}", description=query):
694\|          r = node.query(query).output.strip()
695\|          with Then(f"result should match the expected", description=expected):
696\|>             assert r == expected, error()
697\|  
698\|  
699\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 Fail 2h 59m
/s3/minio table function OK 1m 5s
/s3/minio table function/auto OK 6s 67ms
/s3/minio table function/compression OK 7s 454ms
/s3/minio table function/credentials OK 638ms
/s3/minio table function/data format OK 5s 762ms
/s3/minio table function/multipart OK 2s 806ms
/s3/minio table function/multiple columns OK 858ms
/s3/minio table function/partition OK 241ms
/s3/minio table function/remote host filter OK 36s 375ms
/s3/minio table function/syntax OK 677ms
/s3/minio table function/wildcard OK 4s 304ms
/s3/minio backup OK 10m 59s
/s3/minio backup/local and s3 disk OK 3m 30s
/s3/minio backup/local and s3 volumes OK 3m 51s
/s3/minio backup/s3 disk OK 3m 37s
/s3/minio invalid table function OK 1s 545ms
/s3/minio invalid table function/empty path OK 173ms
/s3/minio invalid table function/empty structure OK 170ms
/s3/minio invalid table function/invalid compression OK 177ms
/s3/minio invalid table function/invalid credentials OK 195ms
/s3/minio invalid table function/invalid format OK 410ms
/s3/minio invalid table function/invalid path OK 233ms
/s3/minio invalid table function/invalid structure OK 176ms
/s3/minio disk OK 27m 9s
/s3/minio disk/access OK 41s 130ms
/s3/minio disk/access skip check OK 39s 860ms
/s3/minio disk/add storage OK 1m 20s
/s3/minio disk/alter move OK 46s 384ms
/s3/minio disk/alter on cluster modify ttl OK 1m 18s
/s3/minio disk/cache OK 1m 23s
/s3/minio disk/cache default OK 41s 731ms
/s3/minio disk/cache path OK 42s 284ms
/s3/minio disk/compact parts OK 39s 992ms
/s3/minio disk/config over restart OK 51s 917ms
/s3/minio disk/default move factor OK 52s 416ms
/s3/minio disk/delete OK 1m 33s
/s3/minio disk/download appropriate disk OK 1m 3s
/s3/minio disk/environment credentials Skip 964us
/s3/minio disk/exports OK 39s 651ms
/s3/minio disk/generic url Skip 693us
/s3/minio disk/imports OK 40s 210ms
/s3/minio disk/max single part upload size syntax OK 40s 475ms
/s3/minio disk/mergetree OK 2m 42s
/s3/minio disk/mergetree collapsing OK 39s 580ms
/s3/minio disk/mergetree versionedcollapsing OK 42s 20ms
/s3/minio disk/metadata OK 41s 943ms
/s3/minio disk/min bytes for seek syntax OK 40s 16ms
/s3/minio disk/multiple storage OK 42s 640ms
/s3/minio disk/multiple storage query OK 43s 711ms
/s3/minio disk/perform ttl move on insert OK 1m 20s
/s3/minio disk/perform ttl move on insert default OK 43s 641ms
/s3/minio disk/performance ttl move OK 49s 836ms
/s3/minio disk/remote host filter OK 1m 19s
/s3/minio disk/restart OK 13s 609ms
/s3/minio disk/specific url Skip 1ms
/s3/minio disk/syntax OK 39s 202ms
/s3/minio disk/wide parts OK 35s 943ms
/s3/minio invalid disk OK 1m 54s
/s3/minio invalid disk/access default OK 14s 706ms
/s3/minio invalid disk/access failed OK 15s 637ms
/s3/minio invalid disk/access failed skip check OK 37s 437ms
/s3/minio invalid disk/cache path conflict OK 8s 504ms
/s3/minio invalid disk/empty endpoint OK 9s 518ms
/s3/minio invalid disk/invalid endpoint OK 9s 654ms
/s3/minio invalid disk/invalid type OK 19s 140ms
/s3/minio sanity OK 42s 768ms
/s3/minio sanity/sanity OK 4s 664ms
/s3/minio reconnect OK 2m 46s
/s3/minio reconnect/local and s3 disk OK 45s 934ms
/s3/minio reconnect/local and s3 volumes OK 1m 0s
/s3/minio reconnect/s3 disk OK 1m 0s
/s3/minio zero copy replication Fail 2h 11m
/s3/minio zero copy replication/add replica OK 35s 141ms
/s3/minio zero copy replication/alter XFail 25m 57s
/s3/minio zero copy replication/alter repeat XFail 25m 52s
/s3/minio zero copy replication/default value OK 11s 142ms
/s3/minio zero copy replication/delete XFail 39s 401ms
/s3/minio zero copy replication/delete all OK 41s 389ms
/s3/minio zero copy replication/drop alter replica OK 1m 0s
/s3/minio zero copy replication/drop replica OK 53s 585ms
/s3/minio zero copy replication/global setting OK 40s 542ms
/s3/minio zero copy replication/insert multiple replicas OK 39s 469ms
/s3/minio zero copy replication/lost data during mutation Fail 24m 31s
/s3/minio zero copy replication/metadata OK 41s 689ms
/s3/minio zero copy replication/performance alter XFail 30m 29s
/s3/minio zero copy replication/performance insert OK 1m 7s
/s3/minio zero copy replication/performance select XError 15m 37s
/s3/minio zero copy replication/ttl delete XFail 40s 715ms
/s3/minio zero copy replication/ttl move OK 46s 22ms
/s3/cit OK 657ms
/s3/cit/test empty put OK 162ms
/s3/cit/test put OK 209ms
/s3/cit/test put csv OK 151ms
/s3/cit/test put get with redirect OK 95ms

Generated by TestFlows Open-Source Test Framework v1.9.220810.1192506