Disk Level Encryption Test Run Report

DateNov 04, 2024 21:58
Duration1h 26m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse

Summary

97.6%OK
1.8%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Features
30
1
29
Scenarios
138
135
2
1
Steps
25138
25125
7
6

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 25s 667ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 117, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 87, in regression
    Feature(run=load("disk_level_encryption.tests.wide_access_permission", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
           ^^^^^
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 1ms
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 7s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 26m
/disk level encryption/memory disk Skip 2ms
/disk level encryption/column ttl OK 49s 354ms
/disk level encryption/column ttl/column ttl delete OK 25s 90ms
/disk level encryption/column ttl/column ttl move OK 24s 261ms
/disk level encryption/encrypted disk OK 12s 408ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 406ms
/disk level encryption/application of changes OK 12s 898ms
/disk level encryption/application of changes/application of changes OK 12s 896ms
/disk level encryption/wide access permission OK 25s 668ms
/disk level encryption/wide access permission/wide permission XFail 25s 667ms
/disk level encryption/no rights OK 2m 13s
/disk level encryption/no rights/changing rights many small inserts OK 1m 7s
/disk level encryption/no rights/changing rights one large insert OK 1m 2s
/disk level encryption/no rights/no rights OK 3s 193ms
/disk level encryption/new directories OK 13s 642ms
/disk level encryption/new directories/new directories OK 13s 640ms
/disk level encryption/invalid disk OK 41s 826ms
/disk level encryption/invalid disk/disk not exist OK 13s 339ms
/disk level encryption/invalid disk/parameter is empty OK 14s 252ms
/disk level encryption/invalid disk/parameter is missing OK 14s 232ms
/disk level encryption/distributed table OK 11m 18s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 42s 127ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 40s 42ms
/disk level encryption/distributed table/distributed table replicated one key OK 42s 365ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 40s 483ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 40s 592ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 46s 714ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 46s 691ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 46s 890ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 44s 402ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 46s 843ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 48s 976ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 46s 917ms
/disk level encryption/distributed table/distributed table sharded one key OK 49s 87ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 47s 100ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 49s 190ms
/disk level encryption/replicated table OK 5m 1s
/disk level encryption/replicated table/replicated table one encrypted replica OK 46s 683ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 47s 745ms
/disk level encryption/replicated table/replicated table one key OK 1m 14s
/disk level encryption/replicated table/replicated table three different keys OK 1m 13s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 59s 782ms
/disk level encryption/invalid key size OK 1m 53s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 281ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 14s 277ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 14s 293ms
/disk level encryption/invalid key size/check hex invalid key size default OK 14s 358ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 14s 279ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 14s 308ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 14s 314ms
/disk level encryption/invalid key size/check invalid key size default OK 14s 267ms
/disk level encryption/encryption algorithms OK 5m 56s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 31s 380ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 31s 270ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 31s 340ms
/disk level encryption/encryption algorithms/check default algorithm OK 28s 673ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 23s 529ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 23s 430ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 23s 409ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 31s 278ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 31s 145ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 159ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 23s 324ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 23s 273ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 23s 187ms
/disk level encryption/comparable performance OK 38s 69ms
/disk level encryption/comparable performance/check comparable performance OK 38s 68ms
/disk level encryption/comparable part sizes OK 49s 795ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 24s 888ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 24s 905ms
/disk level encryption/wide and compact formats OK 1m 12s
/disk level encryption/wide and compact formats/check only compact format OK 24s 200ms
/disk level encryption/wide and compact formats/check only wide format OK 24s 177ms
/disk level encryption/wide and compact formats/check wide and compact format OK 24s 468ms
/disk level encryption/multi disk volume OK 3m 38s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 24s 206ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 24s 179ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 24s 215ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 277ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 24s 440ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 332ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 24s 421ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 24s 205ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 24s 155ms
/disk level encryption/multi volume policy OK 10m 51s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 315ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 198ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 373ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 438ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 24s 295ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 33s 416ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 33s 160ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 32s 763ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 33s 156ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 32s 875ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 33s 445ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 32s 459ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 33s 457ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 33s 143ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 33s 666ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 33s 192ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 33s 195ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 32s 838ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 33s 323ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 33s 198ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 32s 580ms
/disk level encryption/missing key OK 40s 341ms
/disk level encryption/missing key/changed key OK 20s 196ms
/disk level encryption/missing key/missing key OK 20s 143ms
/disk level encryption/merge parts OK 13m 57s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 3s
/disk level encryption/merge parts/optimize table a lot of keys OK 12m 54s
/disk level encryption/invalid current key id OK 27s 422ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 218ms
/disk level encryption/invalid current key id/empty current key id OK 14s 202ms
/disk level encryption/multiple keys OK 2m 16s
/disk level encryption/multiple keys/default current key id OK 37s 645ms
/disk level encryption/multiple keys/hex key conflict OK 13s 224ms
/disk level encryption/multiple keys/hex key id conflict OK 14s 203ms
/disk level encryption/multiple keys/invalid key id OK 14s 296ms
/disk level encryption/multiple keys/mixed formats OK 28s 392ms
/disk level encryption/multiple keys/parts with different keys OK 28s 514ms
/disk level encryption/default path OK 3ms
/disk level encryption/default path/default path XError 1ms
/disk level encryption/valid path OK 37s 783ms
/disk level encryption/valid path/path ascii OK 12s 558ms
/disk level encryption/valid path/path nested OK 12s 630ms
/disk level encryption/valid path/path utf8 OK 12s 591ms
/disk level encryption/invalid path OK 27s 551ms
/disk level encryption/invalid path/invalid long path OK 13s 238ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 14s 310ms
/disk level encryption/operations OK 9m 6s
/disk level encryption/operations/alter move multi volume policy OK 2m 56s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 25s 408ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 25s 216ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 105ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 25s 46ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 25s 427ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 25s 159ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 25s 351ms
/disk level encryption/operations/alter move multi disk volume OK 1m 41s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 25s 305ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 25s 320ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 25s 406ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 25s 128ms
/disk level encryption/operations/insert and select OK 4m 28s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 22s 652ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 588ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 6s 465ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 426ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 23s 216ms
/disk level encryption/operations/insert and select/check insert back to back OK 1s 258ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 4s 730ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 13s 747ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 7s 541ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 4s 77ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 3s 996ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 15s 93ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 36s 550ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 35s 830ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 34s 36ms
/disk level encryption/key formats OK 50s 575ms
/disk level encryption/key formats/ascii OK 12s 654ms
/disk level encryption/key formats/hexadecimal OK 12s 569ms
/disk level encryption/key formats/special xml symbols OK 12s 700ms
/disk level encryption/key formats/utf-8 OK 12s 647ms
/disk level encryption/encryption at rest OK 10m 7s
/disk level encryption/encryption at rest/corner case check XFail 10m 7s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204