Document status - Confidential


S3 Test Run Report

DateJul 20, 2022 16:32
Duration1h 7m
Framework TestFlows 1.9.220712.1163352

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/2747237115/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameVitaliy Zakaznikov
user.emailvzakaznikov@protonmail.com
version22.3.8.40
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id2747237115
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/2747237115
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse
stressFalse
storages['aws_s3']
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Tags

altinity-docker-runner

Summary

79.5%OK
17.3%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
11
3
8
Features
11
3
8
Scenarios
100
92
8
Examples
62
38
24
Steps
13453
13278
153
22

Known Fails

Test NameResultMessage
/s3/aws s3 disk/generic urlXFail 2ms
not yet supported
Generic URL is treated as invalid configuration, ClickHouse
             will not start if config is added
/s3/aws s3 zero copy replication/add replicaXFail 45s 584ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 382, in add_replica
    assert size_after + 1 == get_bucket_size(
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()

Assertion values
  assert size_after + 1 == get_bucket_size(
         ^ is 0
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
                    ^ is = 1
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
           ^ is 'altinity-qa-test'
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
             ^ is 'data/zero-copy-replication'
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
                    ^ is False
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
                 ^ is 
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
                 ^ is = 
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
                 ^ is 
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
                 ^ is = '[masked]:Secret(name='aws_s3_access_key')'
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
             ^ is 
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
             ^ is = 
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
             ^ is 
  ), error()
  assert size_after + 1 == get_bucket_size(
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
             ^ is = '[masked]:Secret(name='aws_s3_key_id')'
  ), error()
  assert size_after + 1 == get_bucket_size(
                           ^ is = 0
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
                        ^ is = False
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()
  assert size_after + 1 == get_bucket_size(
  ^ is False
      name=bucket_name,
      prefix=bucket_path,
      minio_enabled=minio_enabled,
      access_key=self.context.secret_access_key,
      key_id=self.context.access_key_id,
  ), error()

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py', line 388 in 'add_replica'

380\|                        than previously because of the additional replica"""
381\|              ):
382\|                  assert size_after + 1 == get_bucket_size(
383\|                      name=bucket_name,
384\|                      prefix=bucket_path,
385\|                      minio_enabled=minio_enabled,
386\|                      access_key=self.context.secret_access_key,
387\|                      key_id=self.context.access_key_id,
388\|>                 ), error()
389\|  
390\|              with And("I check simple queries on the first node"):
391\|                  check_query_node(
/s3/aws s3 zero copy replication/alterXFail 1m 44s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 852, in alter
    assert False, "data in S3 has grown by more than 50%"
AssertionError: data in S3 has grown by more than 50%
/s3/aws s3 zero copy replication/alter repeatXFail 1m 46s
https://github.com/ClickHouse/ClickHouse/issues/22516
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1014, in alter_repeat
    assert False, "data in S3 has grown by more than 50%"
AssertionError: data in S3 has grown by more than 50%
/s3/aws s3 zero copy replication/delete allXFail 45s 534ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1374, in delete_all
    assert (
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()

Assertion values
  assert (
      get_bucket_size(
          name=bucket_name,
               ^ is 'altinity-qa-test'
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
                 ^ is 'data/zero-copy-replication'
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
                        ^ is False
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
                     ^ is 
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
                     ^ is = 
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
                     ^ is 
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
                     ^ is = '[masked]:Secret(name='aws_s3_access_key')'
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
                 ^ is 
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
                 ^ is = 
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
                 ^ is 
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
                 ^ is = '[masked]:Secret(name='aws_s3_key_id')'
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
      ^ is = 0
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
        ^ is 0
  ), error()
  assert (
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
      ^ is = False
  ), error()
  assert (
  ^ is False
      get_bucket_size(
          name=bucket_name,
          prefix=bucket_path,
          minio_enabled=minio_enabled,
          access_key=self.context.secret_access_key,
          key_id=self.context.access_key_id,
      )
      > size_before
  ), error()

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py', line 1383 in 'delete_all'

1375\|                      get_bucket_size(
1376\|                          name=bucket_name,
1377\|                          prefix=bucket_path,
1378\|                          minio_enabled=minio_enabled,
1379\|                          access_key=self.context.secret_access_key,
1380\|                          key_id=self.context.access_key_id,
1381\|                      )
1382\|                      > size_before
1383\|>                 ), error()
1384\|  
1385\|          finally:
1386\|              with Finally("I drop the table on each node"):
/s3/aws s3 zero copy replication/insert multiple replicasXFail 46s 520ms
Under investigation
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1184, in insert_multiple_replicas
    assert added_size >= expected * 0.99, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert added_size >= expected * 0.99, error()

Assertion values
  assert added_size >= expected * 0.99, error()
         ^ is 0
  assert added_size >= expected * 0.99, error()
                       ^ is 6306510
  assert added_size >= expected * 0.99, error()
                                ^ is = 6243444.9
  assert added_size >= expected * 0.99, error()
                    ^ is = False
  assert added_size >= expected * 0.99, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py', line 1184 in 'insert_multiple_replicas'

1176\|                      name=bucket_name,
1177\|                      prefix=bucket_path,
1178\|                      minio_enabled=minio_enabled,
1179\|                      access_key=self.context.secret_access_key,
1180\|                      key_id=self.context.access_key_id,
1181\|                  )
1182\|                  added_size = current_size - size_before
1183\|  
1184\|>                 assert added_size >= expected * 0.99, error()
1185\|                  assert added_size <= expected * 1.01, error()
1186\|  
1187\|          finally:
/s3/aws s3 zero copy replication/ttl deleteXFail 46s 306ms
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "regression/s3/regression.py", line 447, in 
    regression()
  File "regression/s3/regression.py", line 427, in regression
    aws_s3_regression(
  File "regression/s3/regression.py", line 321, in aws_s3_regression
    Feature(test=load("s3.tests.zero_copy_replication", "aws_s3"))(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2094, in aws_s3
    outline()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 2078, in outline
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/zero_copy_replication.py", line 1644, in ttl_delete
    check_query_node(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py", line 696, in check_query_node
    assert r == expected, error()
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/s3/../s3/tests/common.py', line 696 in 'check_query_node'

688\|  
689\|  @TestStep(Then)
690\|  def check_query_node(self, node, num, query, expected):
691\|      node = current().context.node
692\|  
693\|      with By(f"executing query {num}", description=query):
694\|          r = node.query(query).output.strip()
695\|          with Then(f"result should match the expected", description=expected):
696\|>             assert r == expected, error()
697\|  
698\|  
699\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 1h 7m
/s3/aws s3 table function OK 2m 59s
/s3/aws s3 table function/auto OK 8s 869ms
/s3/aws s3 table function/compression OK 8s 596ms
/s3/aws s3 table function/credentials OK 1s 39ms
/s3/aws s3 table function/data format OK 7s 558ms
/s3/aws s3 table function/multipart OK 4s 45ms
/s3/aws s3 table function/multiple columns OK 1s 283ms
/s3/aws s3 table function/partition OK 1s 92ms
/s3/aws s3 table function/remote host filter OK 39s 388ms
/s3/aws s3 table function/syntax OK 889ms
/s3/aws s3 table function/wildcard OK 17s 471ms
/s3/aws s3 table function/ssec encryption check Skip 435us
/s3/aws s3 table function/ssec OK 1m 29s
/s3/aws s3 table function/ssec/auto OK 6s 493ms
/s3/aws s3 table function/ssec/compression OK 6s 410ms
/s3/aws s3 table function/ssec/credentials OK 1s 869ms
/s3/aws s3 table function/ssec/data format OK 8s 134ms
/s3/aws s3 table function/ssec/multipart OK 3s 883ms
/s3/aws s3 table function/ssec/multiple columns OK 2s 103ms
/s3/aws s3 table function/ssec/partition OK 4s 104ms
/s3/aws s3 table function/ssec/remote host filter OK 38s 52ms
/s3/aws s3 table function/ssec/syntax OK 2s 51ms
/s3/aws s3 table function/ssec/wildcard OK 2s 497ms
/s3/aws s3 invalid table function OK 1s 509ms
/s3/aws s3 invalid table function/empty path OK 153ms
/s3/aws s3 invalid table function/empty structure OK 147ms
/s3/aws s3 invalid table function/invalid compression OK 146ms
/s3/aws s3 invalid table function/invalid credentials OK 303ms
/s3/aws s3 invalid table function/invalid format OK 368ms
/s3/aws s3 invalid table function/invalid path OK 162ms
/s3/aws s3 invalid table function/invalid structure OK 213ms
/s3/aws s3 disk OK 32m 25s
/s3/aws s3 disk/access OK 43s 536ms
/s3/aws s3 disk/access skip check OK 41s 577ms
/s3/aws s3 disk/add storage OK 1m 25s
/s3/aws s3 disk/alter move OK 50s 599ms
/s3/aws s3 disk/alter on cluster modify ttl OK 1m 27s
/s3/aws s3 disk/cache OK 1m 28s
/s3/aws s3 disk/cache default OK 45s 698ms
/s3/aws s3 disk/cache path OK 44s 229ms
/s3/aws s3 disk/compact parts OK 40s 397ms
/s3/aws s3 disk/config over restart OK 1m 11s
/s3/aws s3 disk/default move factor OK 57s 879ms
/s3/aws s3 disk/delete OK 2m 11s
/s3/aws s3 disk/download appropriate disk OK 1m 10s
/s3/aws s3 disk/environment credentials OK 1m 21s
/s3/aws s3 disk/exports OK 44s 226ms
/s3/aws s3 disk/generic url XFail 2ms
/s3/aws s3 disk/imports OK 40s 245ms
/s3/aws s3 disk/max single part upload size syntax OK 45s 625ms
/s3/aws s3 disk/mergetree OK 3m 9s
/s3/aws s3 disk/mergetree collapsing OK 45s 210ms
/s3/aws s3 disk/mergetree versionedcollapsing OK 44s 83ms
/s3/aws s3 disk/metadata OK 42s 203ms
/s3/aws s3 disk/min bytes for seek syntax OK 41s 12ms
/s3/aws s3 disk/multiple storage OK 47s 516ms
/s3/aws s3 disk/multiple storage query OK 48s 987ms
/s3/aws s3 disk/perform ttl move on insert OK 1m 27s
/s3/aws s3 disk/perform ttl move on insert default OK 46s 284ms
/s3/aws s3 disk/performance ttl move OK 56s 523ms
/s3/aws s3 disk/remote host filter OK 1m 23s
/s3/aws s3 disk/restart OK 16s 479ms
/s3/aws s3 disk/specific url OK 40s 284ms
/s3/aws s3 disk/syntax OK 47s 14ms
/s3/aws s3 disk/wide parts OK 40s 873ms
/s3/aws s3 disk/ssec Skip 751us
/s3/aws s3 sanity OK 48s 873ms
/s3/aws s3 sanity/sanity OK 8s 103ms
/s3/aws s3 invalid disk OK 2m 2s
/s3/aws s3 invalid disk/access default OK 15s 643ms
/s3/aws s3 invalid disk/access failed OK 15s 566ms
/s3/aws s3 invalid disk/access failed skip check OK 40s 714ms
/s3/aws s3 invalid disk/cache path conflict OK 12s 613ms
/s3/aws s3 invalid disk/empty endpoint OK 9s 498ms
/s3/aws s3 invalid disk/invalid endpoint OK 9s 554ms
/s3/aws s3 invalid disk/invalid type OK 19s 68ms
/s3/aws s3 zero copy replication OK 15m 46s
/s3/aws s3 zero copy replication/add replica XFail 45s 584ms
/s3/aws s3 zero copy replication/alter XFail 1m 44s
/s3/aws s3 zero copy replication/alter repeat XFail 1m 46s
/s3/aws s3 zero copy replication/default value OK 12s 152ms
/s3/aws s3 zero copy replication/delete OK 48s 4ms
/s3/aws s3 zero copy replication/delete all XFail 45s 534ms
/s3/aws s3 zero copy replication/drop alter replica OK 56s 433ms
/s3/aws s3 zero copy replication/drop replica OK 59s 762ms
/s3/aws s3 zero copy replication/global setting OK 43s 776ms
/s3/aws s3 zero copy replication/insert multiple replicas XFail 46s 520ms
/s3/aws s3 zero copy replication/metadata OK 44s 29ms
/s3/aws s3 zero copy replication/performance alter OK 1m 11s
/s3/aws s3 zero copy replication/performance insert OK 1m 11s
/s3/aws s3 zero copy replication/performance select OK 1m 13s
/s3/aws s3 zero copy replication/ttl delete XFail 46s 306ms
/s3/aws s3 zero copy replication/ttl move OK 52s 205ms
/s3/aws s3 reconnect OK 2m 43s
/s3/aws s3 reconnect/local and s3 disk OK 48s 63ms
/s3/aws s3 reconnect/local and s3 volumes OK 55s 795ms
/s3/aws s3 reconnect/s3 disk OK 1m 0s
/s3/aws s3 backup Skip 1ms

Generated by TestFlows Open-Source Test Framework v1.9.220712.1163352