Disk Level Encryption Test Run Report

DateApr 28, 2024 17:21
Duration1h 35m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_aarch64/clickhouse-common-static_23.8.11.29.altinitystable_arm64.deb
version23.8.11.29.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash17a81c07fc1f41fbee651e0ef0ca4b44e537e5b1
job.id8868426423
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8868426423
archaarch64
stressFalse
allow_vfsFalse
allow_experimental_analyzerFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_aarch64/clickhouse-common-static_23.8.11.29.altinitystable_arm64.deb
collect_service_logsTrue

Summary

97.6%OK
1.8%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Features
30
1
29
Scenarios
138
135
2
1
Steps
25103
25096
7

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 26s 967ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 117, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 87, in regression
    Feature(run=load("disk_level_encryption.tests.wide_access_permission", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 709us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 12s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 35m
/disk level encryption/memory disk Skip 1ms
/disk level encryption/column ttl OK 56s 379ms
/disk level encryption/column ttl/column ttl delete OK 27s 648ms
/disk level encryption/column ttl/column ttl move OK 28s 729ms
/disk level encryption/encrypted disk OK 15s 643ms
/disk level encryption/encrypted disk/encrypted disk OK 15s 642ms
/disk level encryption/application of changes OK 16s 706ms
/disk level encryption/application of changes/application of changes OK 16s 705ms
/disk level encryption/wide access permission OK 26s 968ms
/disk level encryption/wide access permission/wide permission XFail 26s 967ms
/disk level encryption/no rights OK 2m 16s
/disk level encryption/no rights/changing rights many small inserts OK 1m 7s
/disk level encryption/no rights/changing rights one large insert OK 1m 5s
/disk level encryption/no rights/no rights OK 3s 168ms
/disk level encryption/new directories OK 14s 604ms
/disk level encryption/new directories/new directories OK 14s 602ms
/disk level encryption/invalid disk OK 39s 328ms
/disk level encryption/invalid disk/disk not exist OK 13s 104ms
/disk level encryption/invalid disk/parameter is empty OK 13s 85ms
/disk level encryption/invalid disk/parameter is missing OK 13s 136ms
/disk level encryption/distributed table OK 12m 5s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 45s 489ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 43s 454ms
/disk level encryption/distributed table/distributed table replicated one key OK 45s 390ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 43s 376ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 45s 272ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 51s 500ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 49s 762ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 47s 614ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 49s 646ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 51s 620ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 49s 672ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 51s 750ms
/disk level encryption/distributed table/distributed table sharded one key OK 49s 676ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 51s 723ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 49s 677ms
/disk level encryption/replicated table OK 5m 37s
/disk level encryption/replicated table/replicated table one encrypted replica OK 52s 288ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 52s 111ms
/disk level encryption/replicated table/replicated table one key OK 1m 22s
/disk level encryption/replicated table/replicated table three different keys OK 1m 22s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 7s
/disk level encryption/invalid key size OK 1m 44s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 68ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 80ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 52ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 78ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 76ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 174ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 89ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 91ms
/disk level encryption/encryption algorithms OK 6m 48s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 34s 597ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 34s 680ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 34s 620ms
/disk level encryption/encryption algorithms/check default algorithm OK 33s 755ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 27s 923ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 27s 975ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 27s 894ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 34s 614ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 34s 592ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 34s 526ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 27s 921ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 27s 912ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 27s 948ms
/disk level encryption/comparable performance OK 38s 46ms
/disk level encryption/comparable performance/check comparable performance OK 38s 43ms
/disk level encryption/comparable part sizes OK 1m 1s
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 30s 913ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 30s 843ms
/disk level encryption/wide and compact formats OK 1m 30s
/disk level encryption/wide and compact formats/check only compact format OK 30s 273ms
/disk level encryption/wide and compact formats/check only wide format OK 30s 509ms
/disk level encryption/wide and compact formats/check wide and compact format OK 29s 767ms
/disk level encryption/multi disk volume OK 4m 18s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 28s 806ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 28s 717ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 28s 738ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 28s 634ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 28s 542ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 28s 596ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 28s 641ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 28s 790ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 28s 644ms
/disk level encryption/multi volume policy OK 12m 8s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 28s 793ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 28s 860ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 28s 877ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 28s 806ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 28s 811ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 36s 678ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 36s 459ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 36s 527ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 36s 575ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 36s 480ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 36s 432ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 36s 564ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 36s 580ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 36s 536ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 36s 488ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 36s 486ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 36s 379ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 36s 485ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 36s 296ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 36s 441ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 36s 521ms
/disk level encryption/missing key OK 44s 476ms
/disk level encryption/missing key/changed key OK 22s 247ms
/disk level encryption/missing key/missing key OK 22s 226ms
/disk level encryption/merge parts OK 14m 59s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 16s
/disk level encryption/merge parts/optimize table a lot of keys OK 13m 42s
/disk level encryption/invalid current key id OK 26s 176ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 120ms
/disk level encryption/invalid current key id/empty current key id OK 13s 53ms
/disk level encryption/multiple keys OK 2m 27s
/disk level encryption/multiple keys/default current key id OK 40s 798ms
/disk level encryption/multiple keys/hex key conflict OK 13s 96ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 47ms
/disk level encryption/multiple keys/invalid key id OK 13s 39ms
/disk level encryption/multiple keys/mixed formats OK 33s 559ms
/disk level encryption/multiple keys/parts with different keys OK 33s 581ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 709us
/disk level encryption/valid path OK 46s 880ms
/disk level encryption/valid path/path ascii OK 15s 642ms
/disk level encryption/valid path/path nested OK 15s 582ms
/disk level encryption/valid path/path utf8 OK 15s 653ms
/disk level encryption/invalid path OK 26s 219ms
/disk level encryption/invalid path/invalid long path OK 13s 134ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 82ms
/disk level encryption/operations OK 11m 49s
/disk level encryption/operations/alter move multi volume policy OK 3m 26s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 29s 635ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 29s 406ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 29s 444ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 29s 432ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 29s 548ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 29s 374ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 29s 470ms
/disk level encryption/operations/alter move multi disk volume OK 1m 57s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 29s 498ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 29s 501ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 29s 440ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 29s 507ms
/disk level encryption/operations/insert and select OK 6m 24s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 25s 273ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 25s 685ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 379ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 25s 594ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 25s 593ms
/disk level encryption/operations/insert and select/check insert back to back OK 1s 124ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 6s 277ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 28s 664ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 24s 290ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 7s 534ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 7s 665ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 18s 523ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 57s 883ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 58s 629ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 53s 372ms
/disk level encryption/key formats OK 1m 2s
/disk level encryption/key formats/ascii OK 15s 702ms
/disk level encryption/key formats/hexadecimal OK 15s 665ms
/disk level encryption/key formats/special xml symbols OK 15s 684ms
/disk level encryption/key formats/utf-8 OK 15s 733ms
/disk level encryption/encryption at rest OK 10m 12s
/disk level encryption/encryption at rest/corner case check XFail 10m 12s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232