Disk Level Encryption Test Run Report

DateAug 03, 2023 4:04
Duration1h 25m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.20.12.altinitystable/5744038919/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/7fb126d648460c159657a337b2f0cc24fbbce2ee/package_release/clickhouse-common-static_22.8.20.12.altinitystable_amd64.deb
version22.8.20.12.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashb13df10b2ee4ce720b5635d1e0208debff3f6ca8
job.id5744038919
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/5744038919
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/7fb126d648460c159657a337b2f0cc24fbbce2ee/package_release/clickhouse-common-static_22.8.20.12.altinitystable_amd64.deb
collect_service_logsTrue

Summary

98%OK
2%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
30
30
Features
30
30
Scenarios
139
135
3
1
Steps
24023
24014
9

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 23s 863ms
not supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 88, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 77, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 61, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py", line 777, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.20):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO 04a59448_31b3_11ee_8e28_33f152b4bf83 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py', line 777 in 'query'

769\|                  assert message in r.output, error(r.output)
770\|  
771\|          if not ignore_exception:
772\|              if message is None or "Exception:" not in message:
773\|                  with Then("check if output has exception") if steps else NullStep():
774\|                      if "Exception:" in r.output:
775\|                          if raise_on_exception:
776\|                              raise QueryRuntimeException(r.output)
777\|>                         assert False, error(r.output)
778\|  
779\|          return r
780\|
/disk level encryption/wide access permission/wide permissionXFail 25s 227ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 136, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 94, in regression
    Feature(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 703us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 8s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 25m
/disk level encryption/memory disk OK 23s 865ms
/disk level encryption/memory disk/memory disk XFail 23s 863ms
/disk level encryption/column ttl OK 48s 822ms
/disk level encryption/column ttl/column ttl delete OK 24s 325ms
/disk level encryption/column ttl/column ttl move OK 24s 496ms
/disk level encryption/encrypted disk OK 12s 503ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 502ms
/disk level encryption/application of changes OK 13s 169ms
/disk level encryption/application of changes/application of changes OK 13s 168ms
/disk level encryption/wide access permission OK 25s 228ms
/disk level encryption/wide access permission/wide permission XFail 25s 227ms
/disk level encryption/no rights OK 2m 23s
/disk level encryption/no rights/changing rights many small inserts OK 1m 20s
/disk level encryption/no rights/changing rights one large insert OK 1m 1s
/disk level encryption/no rights/no rights OK 1s 125ms
/disk level encryption/new directories OK 13s 564ms
/disk level encryption/new directories/new directories OK 13s 562ms
/disk level encryption/invalid disk OK 41s 854ms
/disk level encryption/invalid disk/disk not exist OK 13s 972ms
/disk level encryption/invalid disk/parameter is empty OK 13s 906ms
/disk level encryption/invalid disk/parameter is missing OK 13s 974ms
/disk level encryption/distributed table OK 11m 21s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 42s 470ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 42s 307ms
/disk level encryption/distributed table/distributed table replicated one key OK 42s 404ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 40s 318ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 42s 385ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 44s 468ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 48s 680ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 46s 485ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 46s 459ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 48s 615ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 46s 491ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 48s 576ms
/disk level encryption/distributed table/distributed table sharded one key OK 46s 573ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 48s 600ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 46s 719ms
/disk level encryption/replicated table OK 5m 5s
/disk level encryption/replicated table/replicated table one encrypted replica OK 48s 381ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 48s 402ms
/disk level encryption/replicated table/replicated table one key OK 1m 15s
/disk level encryption/replicated table/replicated table three different keys OK 1m 13s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 0s
/disk level encryption/invalid key size OK 1m 51s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 885ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 964ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 883ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 890ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 906ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 888ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 924ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 898ms
/disk level encryption/encryption algorithms OK 6m 2s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 31s 478ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 31s 518ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 31s 548ms
/disk level encryption/encryption algorithms/check default algorithm OK 29s 99ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 24s 91ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 24s 69ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 24s 13ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 31s 541ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 31s 562ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 558ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 23s 938ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 24s 126ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 24s 76ms
/disk level encryption/comparable performance OK 28s 124ms
/disk level encryption/comparable performance/check comparable performance OK 28s 122ms
/disk level encryption/comparable part sizes OK 51s 388ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 25s 714ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 25s 672ms
/disk level encryption/wide and compact formats OK 1m 15s
/disk level encryption/wide and compact formats/check only compact format OK 25s 433ms
/disk level encryption/wide and compact formats/check only wide format OK 25s 228ms
/disk level encryption/wide and compact formats/check wide and compact format OK 25s 85ms
/disk level encryption/multi disk volume OK 3m 40s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 24s 414ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 24s 594ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 24s 521ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 505ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 24s 665ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 513ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 24s 520ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 24s 548ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 24s 514ms
/disk level encryption/multi volume policy OK 10m 8s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 662ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 642ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 646ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 656ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 24s 580ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 30s 355ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 30s 248ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 30s 265ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 30s 311ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 30s 313ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 30s 309ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 30s 359ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 30s 349ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 30s 257ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 30s 364ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 30s 364ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 30s 427ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 30s 245ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 30s 280ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 30s 338ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 30s 373ms
/disk level encryption/missing key OK 40s 140ms
/disk level encryption/missing key/changed key OK 20s 69ms
/disk level encryption/missing key/missing key OK 20s 69ms
/disk level encryption/merge parts OK 12m 12s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 5s
/disk level encryption/merge parts/optimize table a lot of keys OK 11m 7s
/disk level encryption/invalid current key id OK 27s 774ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 887ms
/disk level encryption/invalid current key id/empty current key id OK 13s 886ms
/disk level encryption/multiple keys OK 2m 16s
/disk level encryption/multiple keys/default current key id OK 37s 867ms
/disk level encryption/multiple keys/hex key conflict OK 12s 860ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 902ms
/disk level encryption/multiple keys/invalid key id OK 13s 894ms
/disk level encryption/multiple keys/mixed formats OK 29s 39ms
/disk level encryption/multiple keys/parts with different keys OK 29s 61ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 703us
/disk level encryption/valid path OK 37s 692ms
/disk level encryption/valid path/path ascii OK 12s 613ms
/disk level encryption/valid path/path nested OK 12s 527ms
/disk level encryption/valid path/path utf8 OK 12s 549ms
/disk level encryption/invalid path OK 26s 776ms
/disk level encryption/invalid path/invalid long path OK 12s 888ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 886ms
/disk level encryption/operations OK 10m 0s
/disk level encryption/operations/alter move multi volume policy OK 2m 55s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 25s 234ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 25s 46ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 177ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 25s 188ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 25s 128ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 25s 54ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 25s 149ms
/disk level encryption/operations/alter move multi disk volume OK 1m 40s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 25s 104ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 25s 41ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 25s 103ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 25s 102ms
/disk level encryption/operations/insert and select OK 5m 24s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 23s 271ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 146ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 3s 899ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 765ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 23s 355ms
/disk level encryption/operations/insert and select/check insert back to back OK 868ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 2s 750ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 20s 105ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 17s 586ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 4s 846ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 4s 779ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 16s 241ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 52s 517ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 48s 767ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 44s 799ms
/disk level encryption/key formats OK 50s 459ms
/disk level encryption/key formats/ascii OK 12s 624ms
/disk level encryption/key formats/hexadecimal OK 12s 613ms
/disk level encryption/key formats/special xml symbols OK 12s 594ms
/disk level encryption/key formats/utf-8 OK 12s 624ms
/disk level encryption/encryption at rest OK 10m 8s
/disk level encryption/encryption at rest/corner case check XFail 10m 8s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122