Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateApr 13, 2023 19:02
Duration2h 7m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinitystable/4688213790/testflows/

Attributes

projectAltinity/ClickHouse
project.id
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/a454ebb2761c2732ab39211459f19fa026dc8527/package_release/clickhouse-common-static_22.8.15.25.altinitystable_amd64.deb
version22.8.15.25.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash4023e0eafd6319edc79b82d79ab800c0c3cf20ec
job.id4688213790
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/4688213790
archx86_64
stressFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsTrue
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriNone
gcs_key_secretSecret(name='gcs_key_secret')
gcs_key_idSecret(name='gcs_key_id')
gcs_uriSecret(name='gcs_uri')
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/a454ebb2761c2732ab39211459f19fa026dc8527/package_release/clickhouse-common-static_22.8.15.25.altinitystable_amd64.deb
collect_service_logsTrue

Summary

90.9%OK
3%Known
6.1%Error

Statistics

Units OK Fail Error XFail
Modules
1
1
Suites
1
1
Features
1
1
Scenarios
93
87
3
3
Examples
3
3
Steps
12036
11826
206
3
1

Fails

Test NameResultMessage
/tiered storageError 2h 7m
ExpectTimeoutError
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
  File "/usr/lib/python3.10/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.015s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 50, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_modify.py", line 116, in scenario
    node.query(f"DROP TABLE IF EXISTS {name} SYNC", timeout=500)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 721, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 500.000s for '(bash# )\|(\n)'
/tiered storage/with s3gcsError 2h 7m
ExpectTimeoutError
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
  File "/usr/lib/python3.10/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.015s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 50, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_modify.py", line 116, in scenario
    node.query(f"DROP TABLE IF EXISTS {name} SYNC", timeout=500)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 721, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 500.000s for '(bash# )\|(\n)'
/tiered storage/with s3gcs/alter moveError 41m 7s
ExpectTimeoutError
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
  File "/usr/lib/python3.10/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
  File "/usr/local/lib/python3.10/dist-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.015s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 284, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/feature.py", line 50, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/alter_move/concurrent_alter_modify.py", line 116, in scenario
    node.query(f"DROP TABLE IF EXISTS {name} SYNC", timeout=500)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 721, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 500.000s for '(bash# )\|(\n)'

Known Fails

Test NameResultMessage
/tiered storage/with s3gcs/double move while selectXFail 10s 934ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 399, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 387, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 276, in feature
    Scenario(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      ("jbod1" if positive else "external")
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
                  ^ is 0
  ], error()
  assert r == [
      ("jbod1" if positive else "external")
       ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      ("jbod1" if positive else "external")
  ], error()
  assert r == [
  ^ is False
      ("jbod1" if positive else "external")
  ], error()

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          ("jbod1" if positive else "external")
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)

Results

Test Name Result Duration
/tiered storage Error 2h 7m
/tiered storage/with s3gcs Error 2h 7m
/tiered storage/with s3gcs/startup and queries OK 42s 365ms
/tiered storage/with s3gcs/metadata OK 10s 53ms
/tiered storage/with s3gcs/no changes to queries OK 13s 464ms
/tiered storage/with s3gcs/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 21s 339ms
/tiered storage/with s3gcs/system tables OK 190ms
/tiered storage/with s3gcs/system.detached_parts OK 3s 167ms
/tiered storage/with s3gcs/attach or replace partition different policies OK 656ms
/tiered storage/with s3gcs/query parser OK 798ms
/tiered storage/with s3gcs/keep free space OK 14s 896ms
/tiered storage/with s3gcs/no warning about zero max data part size OK 642ms
/tiered storage/with s3gcs/round robin OK 1s 510ms
/tiered storage/with s3gcs/max data part size OK 13s 428ms
/tiered storage/with s3gcs/jbod overflow OK 53s 559ms
/tiered storage/with s3gcs/start stop moves OK 33s 151ms
/tiered storage/with s3gcs/mutate to another disk OK 52s 450ms
/tiered storage/with s3gcs/alter table policy OK 40s 174ms
/tiered storage/with s3gcs/simple replication and moves OK 1m 13s
/tiered storage/with s3gcs/download appropriate disk OK 14s 707ms
/tiered storage/with s3gcs/download appropriate disk advanced OK 24s 937ms
/tiered storage/with s3gcs/download appropriate disk max data part size OK 38s 880ms
/tiered storage/with s3gcs/rename OK 10s 376ms
/tiered storage/with s3gcs/freeze OK 6s 809ms
/tiered storage/with s3gcs/double move while select XFail 10s 934ms
/tiered storage/with s3gcs/background move OK 7m 27s
/tiered storage/with s3gcs/alter move Error 41m 7s
/tiered storage/with s3gcs/merge parts different volumes OK 12s 921ms
/tiered storage/with s3gcs/merge parts different volumes no space OK 12s 860ms
/tiered storage/with s3gcs/ttl moves OK 1h 2m
/tiered storage/with s3gcs/change config norestart OK 5m 30s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122