Disk Level Encryption Test Run Report

DateMar 19, 2024 17:44
Duration1h 17m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
version23.3.19.34.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8247806903
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8247806903
archx86_64
stressFalse
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
collect_service_logsTrue

Summary

97.6%OK
1.8%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Features
30
1
29
Scenarios
138
135
2
1
Steps
25134
25127
7

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 24s 539ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 116, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 86, in regression
    Feature(run=load("disk_level_encryption.tests.wide_access_permission", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 573us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 7s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 17m
/disk level encryption/memory disk Skip 1ms
/disk level encryption/column ttl OK 44s 51ms
/disk level encryption/column ttl/column ttl delete OK 21s 975ms
/disk level encryption/column ttl/column ttl move OK 22s 75ms
/disk level encryption/encrypted disk OK 11s 215ms
/disk level encryption/encrypted disk/encrypted disk OK 11s 214ms
/disk level encryption/application of changes OK 11s 469ms
/disk level encryption/application of changes/application of changes OK 11s 468ms
/disk level encryption/wide access permission OK 24s 541ms
/disk level encryption/wide access permission/wide permission XFail 24s 539ms
/disk level encryption/no rights OK 2m 5s
/disk level encryption/no rights/changing rights many small inserts OK 1m 1s
/disk level encryption/no rights/changing rights one large insert OK 1m 0s
/disk level encryption/no rights/no rights OK 3s 125ms
/disk level encryption/new directories OK 12s 379ms
/disk level encryption/new directories/new directories OK 12s 378ms
/disk level encryption/invalid disk OK 40s 514ms
/disk level encryption/invalid disk/disk not exist OK 12s 812ms
/disk level encryption/invalid disk/parameter is empty OK 13s 792ms
/disk level encryption/invalid disk/parameter is missing OK 13s 908ms
/disk level encryption/distributed table OK 9m 54s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 35s 873ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 37s 556ms
/disk level encryption/distributed table/distributed table replicated one key OK 35s 666ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 35s 92ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 35s 590ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 39s 471ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 39s 459ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 41s 976ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 43s 668ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 39s 257ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 41s 435ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 43s 505ms
/disk level encryption/distributed table/distributed table sharded one key OK 41s 294ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 43s 544ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 41s 439ms
/disk level encryption/replicated table OK 4m 34s
/disk level encryption/replicated table/replicated table one encrypted replica OK 43s 926ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 43s 300ms
/disk level encryption/replicated table/replicated table one key OK 1m 6s
/disk level encryption/replicated table/replicated table three different keys OK 1m 6s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 53s 851ms
/disk level encryption/invalid key size OK 1m 49s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 814ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 871ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 840ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 795ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 841ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 811ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 859ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 840ms
/disk level encryption/encryption algorithms OK 5m 28s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 28s 930ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 28s 886ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 28s 813ms
/disk level encryption/encryption algorithms/check default algorithm OK 26s 3ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 21s 484ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 21s 606ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 21s 566ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 28s 941ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 28s 818ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 29s 1ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 21s 524ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 21s 401ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 21s 332ms
/disk level encryption/comparable performance OK 29s 117ms
/disk level encryption/comparable performance/check comparable performance OK 29s 117ms
/disk level encryption/comparable part sizes OK 44s 423ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 22s 361ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 22s 56ms
/disk level encryption/wide and compact formats OK 1m 5s
/disk level encryption/wide and compact formats/check only compact format OK 21s 807ms
/disk level encryption/wide and compact formats/check only wide format OK 21s 795ms
/disk level encryption/wide and compact formats/check wide and compact format OK 21s 971ms
/disk level encryption/multi disk volume OK 3m 18s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 21s 846ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 22s 0ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 21s 893ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 22s 142ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 22s 197ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 22s 134ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 22s 77ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 22s 71ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 22s 388ms
/disk level encryption/multi volume policy OK 9m 20s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 22s 562ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 22s 548ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 22s 505ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 22s 551ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 22s 558ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 28s 280ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 28s 856ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 28s 237ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 28s 464ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 28s 48ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 27s 676ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 27s 638ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 27s 778ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 27s 758ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 28s 685ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 28s 145ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 27s 501ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 27s 401ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 27s 299ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 27s 931ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 28s 172ms
/disk level encryption/missing key OK 37s 691ms
/disk level encryption/missing key/changed key OK 18s 848ms
/disk level encryption/missing key/missing key OK 18s 841ms
/disk level encryption/merge parts OK 11m 1s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 59s 259ms
/disk level encryption/merge parts/optimize table a lot of keys OK 10m 2s
/disk level encryption/invalid current key id OK 26s 659ms
/disk level encryption/invalid current key id/current key id not refer OK 12s 826ms
/disk level encryption/invalid current key id/empty current key id OK 13s 832ms
/disk level encryption/multiple keys OK 2m 7s
/disk level encryption/multiple keys/default current key id OK 35s 122ms
/disk level encryption/multiple keys/hex key conflict OK 12s 814ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 739ms
/disk level encryption/multiple keys/invalid key id OK 13s 799ms
/disk level encryption/multiple keys/mixed formats OK 26s 92ms
/disk level encryption/multiple keys/parts with different keys OK 26s 132ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 573us
/disk level encryption/valid path OK 34s 311ms
/disk level encryption/valid path/path ascii OK 11s 345ms
/disk level encryption/valid path/path nested OK 11s 461ms
/disk level encryption/valid path/path utf8 OK 11s 502ms
/disk level encryption/invalid path OK 26s 718ms
/disk level encryption/invalid path/invalid long path OK 12s 882ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 835ms
/disk level encryption/operations OK 8m 33s
/disk level encryption/operations/alter move multi volume policy OK 2m 39s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 23s 89ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 22s 696ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 22s 692ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 22s 734ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 22s 702ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 22s 761ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 22s 956ms
/disk level encryption/operations/alter move multi disk volume OK 1m 31s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 23s 41ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 22s 582ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 22s 837ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 23s 93ms
/disk level encryption/operations/insert and select OK 4m 22s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 21s 79ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 21s 122ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 114ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 21s 262ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 21s 282ms
/disk level encryption/operations/insert and select/check insert back to back OK 944ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 2s 891ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 6s 319ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 3s 836ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 2s 191ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 2s 234ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 14s 414ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 44s 697ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 43s 914ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 41s 86ms
/disk level encryption/key formats OK 45s 572ms
/disk level encryption/key formats/ascii OK 11s 468ms
/disk level encryption/key formats/hexadecimal OK 11s 466ms
/disk level encryption/key formats/special xml symbols OK 11s 353ms
/disk level encryption/key formats/utf-8 OK 11s 281ms
/disk level encryption/encryption at rest OK 10m 7s
/disk level encryption/encryption at rest/corner case check XFail 10m 7s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232