Disk Level Encryption Test Run Report

DateJul 14, 2023 15:51
Duration1h 25m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/23.3.8.22.altinitystable/5553084583/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/b2217a3881bc514b436b6e2c0e21eb899b4d4aee/package_release/clickhouse-common-static_23.3.8.22.altinitystable_amd64.deb
version23.3.8.22.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashb13df10b2ee4ce720b5635d1e0208debff3f6ca8
job.id5553084583
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/5553084583
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/b2217a3881bc514b436b6e2c0e21eb899b4d4aee/package_release/clickhouse-common-static_23.3.8.22.altinitystable_amd64.deb
collect_service_logsTrue

Summary

97.5%OK
1.5%Known

Statistics

Units Skip OK Fail XFail XError
Modules
1
1
Suites
30
1
29
Features
30
1
29
Scenarios
138
135
2
1
Steps
23907
23900
7

Known Fails

Test NameResultMessage
/disk level encryption/wide access permission/wide permissionXFail 25s 323ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 94, in regression
    Feature(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 684us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 9s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 25m
/disk level encryption/memory disk Skip 1ms
/disk level encryption/column ttl OK 49s 72ms
/disk level encryption/column ttl/column ttl delete OK 24s 483ms
/disk level encryption/column ttl/column ttl move OK 24s 587ms
/disk level encryption/encrypted disk OK 12s 496ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 494ms
/disk level encryption/application of changes OK 13s 264ms
/disk level encryption/application of changes/application of changes OK 13s 263ms
/disk level encryption/wide access permission OK 25s 325ms
/disk level encryption/wide access permission/wide permission XFail 25s 323ms
/disk level encryption/no rights OK 2m 28s
/disk level encryption/no rights/changing rights many small inserts OK 1m 23s
/disk level encryption/no rights/changing rights one large insert OK 1m 2s
/disk level encryption/no rights/no rights OK 3s 170ms
/disk level encryption/new directories OK 12s 600ms
/disk level encryption/new directories/new directories OK 12s 599ms
/disk level encryption/invalid disk OK 40s 772ms
/disk level encryption/invalid disk/disk not exist OK 12s 951ms
/disk level encryption/invalid disk/parameter is empty OK 13s 924ms
/disk level encryption/invalid disk/parameter is missing OK 13s 894ms
/disk level encryption/distributed table OK 11m 16s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 40s 416ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 42s 466ms
/disk level encryption/distributed table/distributed table replicated one key OK 40s 399ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 42s 523ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 40s 610ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 48s 715ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 47s 818ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 42s 603ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 46s 707ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 49s 754ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 45s 792ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 47s 910ms
/disk level encryption/distributed table/distributed table sharded one key OK 46s 746ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 45s 912ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 48s 9ms
/disk level encryption/replicated table OK 5m 6s
/disk level encryption/replicated table/replicated table one encrypted replica OK 48s 634ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 48s 481ms
/disk level encryption/replicated table/replicated table one key OK 1m 15s
/disk level encryption/replicated table/replicated table three different keys OK 1m 12s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 1s
/disk level encryption/invalid key size OK 1m 50s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 930ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 887ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 943ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 897ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 908ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 908ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 913ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 897ms
/disk level encryption/encryption algorithms OK 6m 3s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 31s 595ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 31s 651ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 31s 619ms
/disk level encryption/encryption algorithms/check default algorithm OK 29s 158ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 24s 45ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 24s 88ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 24s 177ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 31s 614ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 31s 655ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 649ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 24s 57ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 24s 188ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 24s 106ms
/disk level encryption/comparable performance OK 34s 198ms
/disk level encryption/comparable performance/check comparable performance OK 34s 194ms
/disk level encryption/comparable part sizes OK 51s 802ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 25s 959ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 25s 841ms
/disk level encryption/wide and compact formats OK 1m 15s
/disk level encryption/wide and compact formats/check only compact format OK 25s 386ms
/disk level encryption/wide and compact formats/check only wide format OK 25s 445ms
/disk level encryption/wide and compact formats/check wide and compact format OK 25s 126ms
/disk level encryption/multi disk volume OK 3m 42s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 24s 751ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 24s 801ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 24s 690ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 668ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 24s 734ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 600ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 24s 659ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 24s 681ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 24s 572ms
/disk level encryption/multi volume policy OK 10m 16s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 898ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 870ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 786ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 793ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 24s 860ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 30s 873ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 30s 835ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 30s 721ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 30s 689ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 30s 955ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 30s 817ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 30s 723ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 30s 658ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 30s 815ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 30s 847ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 30s 774ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 30s 728ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 30s 644ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 30s 874ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 30s 795ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 30s 726ms
/disk level encryption/missing key OK 40s 371ms
/disk level encryption/missing key/changed key OK 20s 188ms
/disk level encryption/missing key/missing key OK 20s 181ms
/disk level encryption/merge parts OK 12m 16s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 5s
/disk level encryption/merge parts/optimize table a lot of keys OK 11m 10s
/disk level encryption/invalid current key id OK 26s 805ms
/disk level encryption/invalid current key id/current key id not refer OK 12s 909ms
/disk level encryption/invalid current key id/empty current key id OK 13s 893ms
/disk level encryption/multiple keys OK 2m 17s
/disk level encryption/multiple keys/default current key id OK 37s 893ms
/disk level encryption/multiple keys/hex key conflict OK 12s 892ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 915ms
/disk level encryption/multiple keys/invalid key id OK 13s 915ms
/disk level encryption/multiple keys/mixed formats OK 29s 432ms
/disk level encryption/multiple keys/parts with different keys OK 29s 198ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 684us
/disk level encryption/valid path OK 37s 832ms
/disk level encryption/valid path/path ascii OK 12s 646ms
/disk level encryption/valid path/path nested OK 12s 537ms
/disk level encryption/valid path/path utf8 OK 12s 646ms
/disk level encryption/invalid path OK 26s 914ms
/disk level encryption/invalid path/invalid long path OK 12s 937ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 974ms
/disk level encryption/operations OK 10m 9s
/disk level encryption/operations/alter move multi volume policy OK 2m 57s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 25s 404ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 25s 222ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 447ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 25s 390ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 25s 285ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 25s 277ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 25s 320ms
/disk level encryption/operations/alter move multi disk volume OK 1m 41s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 25s 338ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 25s 201ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 25s 290ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 25s 233ms
/disk level encryption/operations/insert and select OK 5m 31s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 23s 362ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 830ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 124ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 715ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 23s 707ms
/disk level encryption/operations/insert and select/check insert back to back OK 908ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 3s 269ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 20s 305ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 17s 467ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 4s 924ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 4s 998ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 16s 483ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 51s 15ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 48s 726ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 51s 905ms
/disk level encryption/key formats OK 51s 586ms
/disk level encryption/key formats/ascii OK 12s 577ms
/disk level encryption/key formats/hexadecimal OK 12s 593ms
/disk level encryption/key formats/special xml symbols OK 12s 640ms
/disk level encryption/key formats/utf-8 OK 13s 772ms
/disk level encryption/encryption at rest OK 10m 9s
/disk level encryption/encryption at rest/corner case check XFail 10m 9s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122