Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Disk Level Encryption Test Run Report

DateApr 13, 2023 14:28
Duration1h 50m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinitystable/4688213790/testflows/

Attributes

projectAltinity/ClickHouse
project.id
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/a454ebb2761c2732ab39211459f19fa026dc8527/package_release/clickhouse-common-static_22.8.15.25.altinitystable_amd64.deb
version22.8.15.25.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash4023e0eafd6319edc79b82d79ab800c0c3cf20ec
job.id4688213790
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/4688213790
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/a454ebb2761c2732ab39211459f19fa026dc8527/package_release/clickhouse-common-static_22.8.15.25.altinitystable_amd64.deb
collect_service_logsTrue

Summary

98%OK
2%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
31
31
Features
31
31
Scenarios
139
135
3
1
Checks
3
3
Iterations
50
50
Steps
28735
28726
9

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 13s 482ms
not supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 132, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 83, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py", line 766, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.15):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO bf7c64e0_da07_11ed_b110_3b88cff4f253 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py', line 766 in 'query'

758\|                  assert message in r.output, error(r.output)
759\|  
760\|          if not ignore_exception:
761\|              if message is None or "Exception:" not in message:
762\|                  with Then("check if output has exception") if steps else NullStep():
763\|                      if "Exception:" in r.output:
764\|                          if raise_on_exception:
765\|                              raise QueryRuntimeException(r.output)
766\|>                         assert False, error(r.output)
767\|  
768\|          return r
769\|
/disk level encryption/wide access permission/wide permissionXFail 25s 607ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 132, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 89, in regression
    Feature(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 1ms
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 5s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 50m
/disk level encryption/memory disk OK 13s 483ms
/disk level encryption/memory disk/memory disk XFail 13s 482ms
/disk level encryption/column ttl OK 48s 808ms
/disk level encryption/column ttl/column ttl delete OK 24s 301ms
/disk level encryption/column ttl/column ttl move OK 24s 505ms
/disk level encryption/encrypted disk OK 12s 542ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 540ms
/disk level encryption/application of changes OK 13s 157ms
/disk level encryption/application of changes/application of changes OK 13s 156ms
/disk level encryption/wide access permission OK 25s 608ms
/disk level encryption/wide access permission/wide permission XFail 25s 607ms
/disk level encryption/no rights OK 2m 28s
/disk level encryption/no rights/changing rights many small inserts OK 1m 25s
/disk level encryption/no rights/changing rights one large insert OK 1m 1s
/disk level encryption/no rights/no rights OK 1s 122ms
/disk level encryption/new directories OK 13s 610ms
/disk level encryption/new directories/new directories OK 13s 608ms
/disk level encryption/invalid disk OK 41s 744ms
/disk level encryption/invalid disk/disk not exist OK 13s 914ms
/disk level encryption/invalid disk/parameter is empty OK 13s 905ms
/disk level encryption/invalid disk/parameter is missing OK 13s 922ms
/disk level encryption/distributed table OK 11m 12s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 40s 286ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 42s 248ms
/disk level encryption/distributed table/distributed table replicated one key OK 42s 382ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 40s 280ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 40s 288ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 42s 414ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 46s 478ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 48s 604ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 44s 415ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 46s 422ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 48s 475ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 46s 502ms
/disk level encryption/distributed table/distributed table sharded one key OK 48s 550ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 46s 590ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 48s 565ms
/disk level encryption/replicated table OK 5m 9s
/disk level encryption/replicated table/replicated table one encrypted replica OK 49s 491ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 49s 377ms
/disk level encryption/replicated table/replicated table one key OK 1m 14s
/disk level encryption/replicated table/replicated table three different keys OK 1m 15s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 0s
/disk level encryption/invalid key size OK 1m 50s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 897ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 878ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 898ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 896ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 874ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 890ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 884ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 922ms
/disk level encryption/encryption algorithms OK 6m 1s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 31s 529ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 31s 484ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 31s 458ms
/disk level encryption/encryption algorithms/check default algorithm OK 29s 206ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 23s 928ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 23s 993ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 23s 931ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 31s 456ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 31s 489ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 579ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 23s 903ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 23s 874ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 23s 962ms
/disk level encryption/comparable performance OK 26m 2s
/disk level encryption/comparable part sizes OK 52s 498ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 26s 817ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 25s 674ms
/disk level encryption/wide and compact formats OK 1m 15s
/disk level encryption/wide and compact formats/check only compact format OK 25s 354ms
/disk level encryption/wide and compact formats/check only wide format OK 25s 423ms
/disk level encryption/wide and compact formats/check wide and compact format OK 25s 15ms
/disk level encryption/multi disk volume OK 3m 40s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 24s 560ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 24s 500ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 24s 491ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 447ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 24s 364ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 357ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 24s 386ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 24s 370ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 24s 543ms
/disk level encryption/multi volume policy OK 10m 7s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 672ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 564ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 590ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 673ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 24s 637ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 30s 392ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 30s 202ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 30s 427ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 30s 250ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 30s 289ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 30s 188ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 30s 148ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 30s 332ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 30s 217ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 30s 300ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 30s 59ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 30s 198ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 30s 318ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 30s 216ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 30s 262ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 30s 347ms
/disk level encryption/missing key OK 40s 207ms
/disk level encryption/missing key/changed key OK 20s 121ms
/disk level encryption/missing key/missing key OK 20s 84ms
/disk level encryption/merge parts OK 12m 12s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 5s
/disk level encryption/merge parts/optimize table a lot of keys OK 11m 7s
/disk level encryption/invalid current key id OK 27s 806ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 911ms
/disk level encryption/invalid current key id/empty current key id OK 13s 893ms
/disk level encryption/multiple keys OK 2m 16s
/disk level encryption/multiple keys/default current key id OK 37s 740ms
/disk level encryption/multiple keys/hex key conflict OK 12s 899ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 896ms
/disk level encryption/multiple keys/invalid key id OK 13s 867ms
/disk level encryption/multiple keys/mixed formats OK 29s 133ms
/disk level encryption/multiple keys/parts with different keys OK 29s 86ms
/disk level encryption/default path OK 2ms
/disk level encryption/default path/default path XError 1ms
/disk level encryption/valid path OK 37s 670ms
/disk level encryption/valid path/path ascii OK 12s 633ms
/disk level encryption/valid path/path nested OK 12s 514ms
/disk level encryption/valid path/path utf8 OK 12s 521ms
/disk level encryption/invalid path OK 27s 851ms
/disk level encryption/invalid path/invalid long path OK 13s 931ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 917ms
/disk level encryption/sanity OK 181ms
/disk level encryption/sanity/select 1 OK 180ms
/disk level encryption/operations OK 10m 1s
/disk level encryption/operations/alter move multi volume policy OK 2m 55s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 25s 153ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 25s 113ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 45ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 25s 73ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 25s 150ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 25s 3ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 24s 991ms
/disk level encryption/operations/alter move multi disk volume OK 1m 40s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 25s 103ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 25s 276ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 25s 284ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 25s 103ms
/disk level encryption/operations/insert and select OK 5m 25s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 23s 589ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 140ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 68ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 591ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 23s 404ms
/disk level encryption/operations/insert and select/check insert back to back OK 832ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 2s 903ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 20s 406ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 17s 885ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 4s 992ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 5s 53ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 17s 154ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 49s 718ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 49s 707ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 45s 745ms
/disk level encryption/key formats OK 50s 487ms
/disk level encryption/key formats/ascii OK 12s 653ms
/disk level encryption/key formats/hexadecimal OK 12s 558ms
/disk level encryption/key formats/special xml symbols OK 12s 588ms
/disk level encryption/key formats/utf-8 OK 12s 683ms
/disk level encryption/encryption at rest OK 10m 5s
/disk level encryption/encryption at rest/corner case check XFail 10m 5s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122