Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Disk Level Encryption Test Run Report

DateSep 19, 2023 7:39
Duration1h 28m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinitystable/6231175917/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/265/6b52da82b6ca003e8ebd34ead5f4eabbc45d1cd6/package_aarch64/clickhouse-common-static_22.8.15.25.altinitystable_arm64.deb
version22.8.15.25.altinitystable
user.nameMyroTk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc23ebf091e566342377fb79fbd78ac3f7a42e678
job.id6231175917
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/6231175917
archaarch64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/265/6b52da82b6ca003e8ebd34ead5f4eabbc45d1cd6/package_aarch64/clickhouse-common-static_22.8.15.25.altinitystable_arm64.deb
collect_service_logsTrue

Summary

98%OK
2%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
30
30
Features
30
30
Scenarios
139
135
3
1
Steps
24013
24004
9

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 24s 239ms
not supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 88, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 77, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 61, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py", line 780, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.15):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO ceadc935_56bf_11ee_bbbd_c39445068891 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py', line 780 in 'query'

772\|                  assert message in r.output, error(r.output)
773\|  
774\|          if not ignore_exception:
775\|              if message is None or "Exception:" not in message:
776\|                  with Then("check if output has exception") if steps else NullStep():
777\|                      if "Exception:" in r.output:
778\|                          if raise_on_exception:
779\|                              raise QueryRuntimeException(r.output)
780\|>                         assert False, error(r.output)
781\|  
782\|          return r
783\|
/disk level encryption/wide access permission/wide permissionXFail 25s 713ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 94, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 903us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 9s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 28m
/disk level encryption/memory disk OK 24s 240ms
/disk level encryption/memory disk/memory disk XFail 24s 239ms
/disk level encryption/column ttl OK 50s 350ms
/disk level encryption/column ttl/column ttl delete OK 24s 970ms
/disk level encryption/column ttl/column ttl move OK 25s 379ms
/disk level encryption/encrypted disk OK 13s 994ms
/disk level encryption/encrypted disk/encrypted disk OK 13s 993ms
/disk level encryption/application of changes OK 13s 871ms
/disk level encryption/application of changes/application of changes OK 13s 869ms
/disk level encryption/wide access permission OK 25s 715ms
/disk level encryption/wide access permission/wide permission XFail 25s 713ms
/disk level encryption/no rights OK 2m 8s
/disk level encryption/no rights/changing rights many small inserts OK 1m 5s
/disk level encryption/no rights/changing rights one large insert OK 1m 2s
/disk level encryption/no rights/no rights OK 1s 127ms
/disk level encryption/new directories OK 12s 898ms
/disk level encryption/new directories/new directories OK 12s 896ms
/disk level encryption/invalid disk OK 40s 436ms
/disk level encryption/invalid disk/disk not exist OK 13s 147ms
/disk level encryption/invalid disk/parameter is empty OK 14s 176ms
/disk level encryption/invalid disk/parameter is missing OK 13s 109ms
/disk level encryption/distributed table OK 11m 37s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 42s 220ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 41s 990ms
/disk level encryption/distributed table/distributed table replicated one key OK 42s 222ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 42s 249ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 42s 213ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 48s 291ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 46s 415ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 44s 241ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 50s 426ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 48s 556ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 50s 585ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 48s 636ms
/disk level encryption/distributed table/distributed table sharded one key OK 50s 535ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 48s 736ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 50s 504ms
/disk level encryption/replicated table OK 5m 8s
/disk level encryption/replicated table/replicated table one encrypted replica OK 48s 418ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 48s 190ms
/disk level encryption/replicated table/replicated table one key OK 1m 15s
/disk level encryption/replicated table/replicated table three different keys OK 1m 15s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 1s
/disk level encryption/invalid key size OK 1m 48s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 91ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 130ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 14s 139ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 218ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 146ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 14s 135ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 106ms
/disk level encryption/invalid key size/check invalid key size default OK 14s 102ms
/disk level encryption/encryption algorithms OK 6m 11s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 32s 173ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 32s 88ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 32s 372ms
/disk level encryption/encryption algorithms/check default algorithm OK 31s 55ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 24s 455ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 24s 422ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 24s 505ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 32s 59ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 32s 236ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 32s 221ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 24s 475ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 24s 732ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 24s 471ms
/disk level encryption/comparable performance OK 30s 646ms
/disk level encryption/comparable performance/check comparable performance OK 30s 645ms
/disk level encryption/comparable part sizes OK 54s 939ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 26s 892ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 28s 45ms
/disk level encryption/wide and compact formats OK 1m 21s
/disk level encryption/wide and compact formats/check only compact format OK 27s 767ms
/disk level encryption/wide and compact formats/check only wide format OK 26s 244ms
/disk level encryption/wide and compact formats/check wide and compact format OK 27s 239ms
/disk level encryption/multi disk volume OK 3m 50s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 25s 628ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 26s 913ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 25s 723ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 25s 239ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 25s 372ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 25s 402ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 25s 508ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 25s 458ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 25s 345ms
/disk level encryption/multi volume policy OK 11m 18s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 25s 361ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 25s 777ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 25s 933ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 27s 206ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 25s 635ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 34s 103ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 33s 391ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 34s 117ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 34s 304ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 35s 96ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 35s 743ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 34s 188ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 33s 906ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 34s 690ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 33s 974ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 33s 900ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 34s 332ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 34s 515ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 33s 838ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 34s 151ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 33s 846ms
/disk level encryption/missing key OK 41s 248ms
/disk level encryption/missing key/changed key OK 20s 567ms
/disk level encryption/missing key/missing key OK 20s 679ms
/disk level encryption/merge parts OK 12m 41s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 6s
/disk level encryption/merge parts/optimize table a lot of keys OK 11m 34s
/disk level encryption/invalid current key id OK 26s 499ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 187ms
/disk level encryption/invalid current key id/empty current key id OK 13s 310ms
/disk level encryption/multiple keys OK 2m 18s
/disk level encryption/multiple keys/default current key id OK 37s 626ms
/disk level encryption/multiple keys/hex key conflict OK 13s 111ms
/disk level encryption/multiple keys/hex key id conflict OK 14s 199ms
/disk level encryption/multiple keys/invalid key id OK 13s 196ms
/disk level encryption/multiple keys/mixed formats OK 29s 102ms
/disk level encryption/multiple keys/parts with different keys OK 31s 469ms
/disk level encryption/default path OK 2ms
/disk level encryption/default path/default path XError 903us
/disk level encryption/valid path OK 42s 755ms
/disk level encryption/valid path/path ascii OK 14s 259ms
/disk level encryption/valid path/path nested OK 14s 356ms
/disk level encryption/valid path/path utf8 OK 14s 136ms
/disk level encryption/invalid path OK 26s 314ms
/disk level encryption/invalid path/invalid long path OK 13s 141ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 170ms
/disk level encryption/operations OK 10m 40s
/disk level encryption/operations/alter move multi volume policy OK 3m 6s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 26s 590ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 26s 238ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 26s 331ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 26s 535ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 27s 634ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 26s 521ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 26s 317ms
/disk level encryption/operations/alter move multi disk volume OK 1m 45s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 26s 244ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 26s 435ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 26s 186ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 26s 358ms
/disk level encryption/operations/insert and select OK 5m 48s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 24s 34ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 657ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 424ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 24s 334ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 24s 402ms
/disk level encryption/operations/insert and select/check insert back to back OK 1s 267ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 4s 247ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 21s 825ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 18s 655ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 5s 656ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 5s 578ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 17s 446ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 54s 169ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 55s 489ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 49s 628ms
/disk level encryption/key formats OK 55s 922ms
/disk level encryption/key formats/ascii OK 14s 79ms
/disk level encryption/key formats/hexadecimal OK 13s 919ms
/disk level encryption/key formats/special xml symbols OK 13s 955ms
/disk level encryption/key formats/utf-8 OK 13s 964ms
/disk level encryption/encryption at rest OK 10m 9s
/disk level encryption/encryption at rest/corner case check XFail 10m 9s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122