Disk Level Encryption Test Run Report

DateDec 26, 2023 12:48
Duration1h 25m
Framework TestFlows 2.0.231130.1212236

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
version23.8.8.21.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash09db6160aac30e37169797b73fac77b4cbca41c6
job.id7328846900
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/7328846900
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
collect_service_logsTrue

Summary

97.5%OK
1.5%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Suites
30
1
29
Features
30
1
29
Scenarios
138
135
2
1
Steps
25126
25119
7

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 24s 941ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 129, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 87, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 1ms
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 7s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 25m
/disk level encryption/memory disk Skip 1ms
/disk level encryption/column ttl OK 46s 237ms
/disk level encryption/column ttl/column ttl delete OK 23s 82ms
/disk level encryption/column ttl/column ttl move OK 23s 153ms
/disk level encryption/encrypted disk OK 11s 811ms
/disk level encryption/encrypted disk/encrypted disk OK 11s 809ms
/disk level encryption/application of changes OK 12s 177ms
/disk level encryption/application of changes/application of changes OK 12s 175ms
/disk level encryption/wide access permission OK 24s 943ms
/disk level encryption/wide access permission/wide permission XFail 24s 941ms
/disk level encryption/no rights OK 2m 13s
/disk level encryption/no rights/changing rights many small inserts OK 1m 6s
/disk level encryption/no rights/changing rights one large insert OK 1m 3s
/disk level encryption/no rights/no rights OK 3s 167ms
/disk level encryption/new directories OK 12s 922ms
/disk level encryption/new directories/new directories OK 12s 921ms
/disk level encryption/invalid disk OK 41s 997ms
/disk level encryption/invalid disk/disk not exist OK 14s 13ms
/disk level encryption/invalid disk/parameter is empty OK 13s 993ms
/disk level encryption/invalid disk/parameter is missing OK 13s 988ms
/disk level encryption/distributed table OK 11m 3s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 41s 388ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 39s 249ms
/disk level encryption/distributed table/distributed table replicated one key OK 41s 306ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 39s 395ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 41s 610ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 47s 584ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 43s 526ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 47s 706ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 45s 650ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 45s 695ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 45s 690ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 45s 667ms
/disk level encryption/distributed table/distributed table sharded one key OK 45s 665ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 46s 848ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 46s 814ms
/disk level encryption/replicated table OK 4m 52s
/disk level encryption/replicated table/replicated table one encrypted replica OK 45s 626ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 45s 129ms
/disk level encryption/replicated table/replicated table one key OK 1m 12s
/disk level encryption/replicated table/replicated table three different keys OK 1m 11s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 57s 768ms
/disk level encryption/invalid key size OK 1m 51s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 997ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 966ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 978ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 978ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 983ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 14s 29ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 979ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 971ms
/disk level encryption/encryption algorithms OK 5m 44s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 30s 140ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 30s 136ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 30s 170ms
/disk level encryption/encryption algorithms/check default algorithm OK 27s 388ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 22s 508ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 23s 423ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 22s 602ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 30s 198ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 30s 98ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 30s 39ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 22s 434ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 22s 611ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 22s 476ms
/disk level encryption/comparable performance OK 42s 123ms
/disk level encryption/comparable performance/check comparable performance OK 42s 121ms
/disk level encryption/comparable part sizes OK 47s 281ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 23s 662ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 23s 617ms
/disk level encryption/wide and compact formats OK 1m 10s
/disk level encryption/wide and compact formats/check only compact format OK 24s 135ms
/disk level encryption/wide and compact formats/check only wide format OK 23s 386ms
/disk level encryption/wide and compact formats/check wide and compact format OK 23s 330ms
/disk level encryption/multi disk volume OK 3m 30s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 23s 181ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 23s 89ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 23s 57ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 94ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 23s 129ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 23s 145ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 23s 202ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 23s 984ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 23s 125ms
/disk level encryption/multi volume policy OK 10m 14s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 23s 382ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 349ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 344ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 475ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 23s 456ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 30s 645ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 31s 705ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 30s 513ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 30s 683ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 31s 336ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 30s 431ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 30s 704ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 31s 653ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 30s 587ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 30s 613ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 31s 557ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 30s 456ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 30s 690ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 30s 835ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 30s 698ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 31s 701ms
/disk level encryption/missing key OK 41s 227ms
/disk level encryption/missing key/changed key OK 20s 583ms
/disk level encryption/missing key/missing key OK 20s 642ms
/disk level encryption/merge parts OK 13m 17s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 4s
/disk level encryption/merge parts/optimize table a lot of keys OK 12m 13s
/disk level encryption/invalid current key id OK 28s 52ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 994ms
/disk level encryption/invalid current key id/empty current key id OK 14s 55ms
/disk level encryption/multiple keys OK 2m 16s
/disk level encryption/multiple keys/default current key id OK 38s 429ms
/disk level encryption/multiple keys/hex key conflict OK 14s 39ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 998ms
/disk level encryption/multiple keys/invalid key id OK 14s 19ms
/disk level encryption/multiple keys/mixed formats OK 28s 363ms
/disk level encryption/multiple keys/parts with different keys OK 27s 295ms
/disk level encryption/default path OK 2ms
/disk level encryption/default path/default path XError 1ms
/disk level encryption/valid path OK 35s 986ms
/disk level encryption/valid path/path ascii OK 11s 978ms
/disk level encryption/valid path/path nested OK 11s 972ms
/disk level encryption/valid path/path utf8 OK 12s 32ms
/disk level encryption/invalid path OK 28s 80ms
/disk level encryption/invalid path/invalid long path OK 14s 29ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 14s 49ms
/disk level encryption/operations OK 10m 10s
/disk level encryption/operations/alter move multi volume policy OK 2m 51s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 24s 971ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 24s 984ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 42ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 24s 931ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 23s 926ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 24s 62ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 23s 906ms
/disk level encryption/operations/alter move multi disk volume OK 1m 35s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 23s 862ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 24s 13ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 24s 20ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 23s 828ms
/disk level encryption/operations/insert and select OK 5m 43s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 21s 960ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 22s 422ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 6s 699ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 22s 174ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 22s 103ms
/disk level encryption/operations/insert and select/check insert back to back OK 992ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 4s 339ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 13s 47ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 9s 491ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 3s 386ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 3s 402ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 17s 621ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 1m 6s
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 1m 3s
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 53s 817ms
/disk level encryption/key formats OK 47s 882ms
/disk level encryption/key formats/ascii OK 11s 969ms
/disk level encryption/key formats/hexadecimal OK 11s 970ms
/disk level encryption/key formats/special xml symbols OK 11s 995ms
/disk level encryption/key formats/utf-8 OK 11s 944ms
/disk level encryption/encryption at rest OK 10m 7s
/disk level encryption/encryption at rest/corner case check XFail 10m 7s

Generated by TestFlows Open-Source Test Framework v2.0.231130.1212236