Disk Level Encryption Test Run Report

DateOct 05, 2023 13:12
Duration1h 29m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/23.3.13.7.altinitystable/6416627213/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/f040635d5f373c5e4be08e5fbec2622a9889adde/package_aarch64/clickhouse-common-static_23.3.13.7.altinitystable_arm64.deb
version23.3.13.7.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash19e8624c5e4ccc65b128d27b19836c0570e53991
job.id6416627213
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/6416627213
archaarch64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/f040635d5f373c5e4be08e5fbec2622a9889adde/package_aarch64/clickhouse-common-static_23.3.13.7.altinitystable_arm64.deb
collect_service_logsTrue

Summary

97.5%OK
1.5%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Suites
30
1
29
Features
30
1
29
Scenarios
138
135
2
1
Steps
23912
23905
7

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 24s 838ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 94, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 948us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 8s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 29m
/disk level encryption/memory disk Skip 997us
/disk level encryption/column ttl OK 49s 564ms
/disk level encryption/column ttl/column ttl delete OK 25s 152ms
/disk level encryption/column ttl/column ttl move OK 24s 410ms
/disk level encryption/encrypted disk OK 14s 54ms
/disk level encryption/encrypted disk/encrypted disk OK 14s 53ms
/disk level encryption/application of changes OK 14s 711ms
/disk level encryption/application of changes/application of changes OK 14s 710ms
/disk level encryption/wide access permission OK 24s 840ms
/disk level encryption/wide access permission/wide permission XFail 24s 838ms
/disk level encryption/no rights OK 2m 11s
/disk level encryption/no rights/changing rights many small inserts OK 1m 5s
/disk level encryption/no rights/changing rights one large insert OK 1m 2s
/disk level encryption/no rights/no rights OK 3s 207ms
/disk level encryption/new directories OK 14s 32ms
/disk level encryption/new directories/new directories OK 14s 30ms
/disk level encryption/invalid disk OK 39s 482ms
/disk level encryption/invalid disk/disk not exist OK 13s 177ms
/disk level encryption/invalid disk/parameter is empty OK 13s 166ms
/disk level encryption/invalid disk/parameter is missing OK 13s 137ms
/disk level encryption/distributed table OK 11m 26s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 42s 426ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 41s 553ms
/disk level encryption/distributed table/distributed table replicated one key OK 42s 327ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 42s 512ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 42s 122ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 48s 569ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 46s 596ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 48s 607ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 47s 765ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 48s 453ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 46s 431ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 48s 520ms
/disk level encryption/distributed table/distributed table sharded one key OK 45s 878ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 48s 733ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 46s 381ms
/disk level encryption/replicated table OK 5m 12s
/disk level encryption/replicated table/replicated table one encrypted replica OK 48s 529ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 49s 669ms
/disk level encryption/replicated table/replicated table one key OK 1m 15s
/disk level encryption/replicated table/replicated table three different keys OK 1m 17s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 1s
/disk level encryption/invalid key size OK 1m 45s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 173ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 185ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 164ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 156ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 82ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 266ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 135ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 273ms
/disk level encryption/encryption algorithms OK 6m 14s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 32s 430ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 32s 249ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 32s 130ms
/disk level encryption/encryption algorithms/check default algorithm OK 30s 886ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 25s 638ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 25s 525ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 25s 559ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 32s 165ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 32s 225ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 32s 177ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 25s 498ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 24s 543ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 23s 574ms
/disk level encryption/comparable performance OK 36s 687ms
/disk level encryption/comparable performance/check comparable performance OK 36s 685ms
/disk level encryption/comparable part sizes OK 54s 97ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 26s 377ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 27s 718ms
/disk level encryption/wide and compact formats OK 1m 21s
/disk level encryption/wide and compact formats/check only compact format OK 27s 111ms
/disk level encryption/wide and compact formats/check only wide format OK 27s 318ms
/disk level encryption/wide and compact formats/check wide and compact format OK 27s 139ms
/disk level encryption/multi disk volume OK 3m 51s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 25s 271ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 26s 192ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 27s 675ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 26s 410ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 26s 329ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 296ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 25s 65ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 25s 48ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 25s 297ms
/disk level encryption/multi volume policy OK 11m 39s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 26s 616ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 25s 692ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 26s 535ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 26s 645ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 26s 670ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 36s 30ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 35s 178ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 34s 696ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 36s 80ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 35s 38ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 35s 919ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 35s 205ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 35s 344ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 35s 350ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 35s 696ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 35s 979ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 34s 985ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 34s 867ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 34s 849ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 35s 937ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 35s 753ms
/disk level encryption/missing key OK 43s 717ms
/disk level encryption/missing key/changed key OK 21s 947ms
/disk level encryption/missing key/missing key OK 21s 768ms
/disk level encryption/merge parts OK 13m 52s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 13s
/disk level encryption/merge parts/optimize table a lot of keys OK 12m 38s
/disk level encryption/invalid current key id OK 26s 452ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 291ms
/disk level encryption/invalid current key id/empty current key id OK 13s 159ms
/disk level encryption/multiple keys OK 2m 19s
/disk level encryption/multiple keys/default current key id OK 37s 874ms
/disk level encryption/multiple keys/hex key conflict OK 13s 269ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 212ms
/disk level encryption/multiple keys/invalid key id OK 13s 305ms
/disk level encryption/multiple keys/mixed formats OK 30s 998ms
/disk level encryption/multiple keys/parts with different keys OK 31s 260ms
/disk level encryption/default path OK 2ms
/disk level encryption/default path/default path XError 948us
/disk level encryption/valid path OK 43s 131ms
/disk level encryption/valid path/path ascii OK 14s 117ms
/disk level encryption/valid path/path nested OK 14s 962ms
/disk level encryption/valid path/path utf8 OK 14s 48ms
/disk level encryption/invalid path OK 26s 619ms
/disk level encryption/invalid path/invalid long path OK 13s 401ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 216ms
/disk level encryption/operations OK 11m 1s
/disk level encryption/operations/alter move multi volume policy OK 3m 16s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 26s 561ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 27s 762ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 28s 781ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 29s 23ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 27s 298ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 28s 565ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 28s 379ms
/disk level encryption/operations/alter move multi disk volume OK 1m 50s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 28s 338ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 27s 376ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 28s 413ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 26s 387ms
/disk level encryption/operations/insert and select OK 5m 54s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 24s 22ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 24s 403ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 412ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 24s 298ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 24s 378ms
/disk level encryption/operations/insert and select/check insert back to back OK 1s 182ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 5s 89ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 22s 425ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 18s 512ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 5s 691ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 5s 656ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 17s 595ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 56s 765ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 56s 988ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 49s 746ms
/disk level encryption/key formats OK 58s 266ms
/disk level encryption/key formats/ascii OK 13s 925ms
/disk level encryption/key formats/hexadecimal OK 13s 911ms
/disk level encryption/key formats/special xml symbols OK 15s 205ms
/disk level encryption/key formats/utf-8 OK 15s 220ms
/disk level encryption/encryption at rest OK 10m 8s
/disk level encryption/encryption at rest/corner case check XFail 10m 8s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122