Document status - Confidential


Disk Level Encryption Test Run Report

DateFeb 10, 2023 19:40
Duration1h 41m
Framework TestFlows 1.9.221228.1171522

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850413/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.8.13.21
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3752850413
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850413
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse

Tags

altinity-docker-runner

Summary

98%OK
2%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
31
31
Features
31
31
Scenarios
139
135
3
1
Checks
3
3
Iterations
50
50
Steps
28728
28719
9

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 13s 23ms
not supported
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 75, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../helpers/cluster.py", line 682, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.13):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO a311f540_a972_11ed_8ec5_0242ac110003 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../helpers/cluster.py', line 682 in 'query'

674\|              ) if steps else NullStep():
675\|                  assert message in r.output, error(r.output)
676\|  
677\|          if message is None or "Exception:" not in message:
678\|              with Then("check if output has exception") if steps else NullStep():
679\|                  if "Exception:" in r.output:
680\|                      if raise_on_exception:
681\|                          raise QueryRuntimeException(r.output)
682\|>                     assert False, error(r.output)
683\|  
684\|          return r
685\|
/disk level encryption/wide access permission/wide permissionXFail 30s 560ms
not implemented
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 81, in regression
    Feature(
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 593us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 5s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 41m
/disk level encryption/memory disk OK 13s 24ms
/disk level encryption/memory disk/memory disk XFail 13s 23ms
/disk level encryption/column ttl OK 50s 109ms
/disk level encryption/column ttl/column ttl delete OK 24s 434ms
/disk level encryption/column ttl/column ttl move OK 25s 673ms
/disk level encryption/encrypted disk OK 12s 110ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 110ms
/disk level encryption/application of changes OK 11s 949ms
/disk level encryption/application of changes/application of changes OK 11s 948ms
/disk level encryption/wide access permission OK 30s 561ms
/disk level encryption/wide access permission/wide permission XFail 30s 560ms
/disk level encryption/no rights OK 2m 4s
/disk level encryption/no rights/changing rights many small inserts OK 1m 1s
/disk level encryption/no rights/changing rights one large insert OK 1m 1s
/disk level encryption/no rights/no rights OK 1s 85ms
/disk level encryption/new directories OK 12s 27ms
/disk level encryption/new directories/new directories OK 12s 26ms
/disk level encryption/invalid disk OK 41s 524ms
/disk level encryption/invalid disk/disk not exist OK 13s 866ms
/disk level encryption/invalid disk/parameter is empty OK 13s 929ms
/disk level encryption/invalid disk/parameter is missing OK 13s 727ms
/disk level encryption/distributed table OK 10m 53s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 38s 402ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 38s 181ms
/disk level encryption/distributed table/distributed table replicated one key OK 38s 158ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 39s 750ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 38s 334ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 42s 511ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 46s 164ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 46s 493ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 47s 774ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 46s 286ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 46s 240ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 46s 468ms
/disk level encryption/distributed table/distributed table sharded one key OK 46s 247ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 45s 722ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 46s 563ms
/disk level encryption/replicated table OK 5m 4s
/disk level encryption/replicated table/replicated table one encrypted replica OK 47s 944ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 47s 91ms
/disk level encryption/replicated table/replicated table one key OK 1m 15s
/disk level encryption/replicated table/replicated table three different keys OK 1m 13s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 0s
/disk level encryption/invalid key size OK 1m 50s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 850ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 903ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 775ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 731ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 806ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 760ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 772ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 808ms
/disk level encryption/encryption algorithms OK 5m 52s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 30s 585ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 30s 915ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 30s 895ms
/disk level encryption/encryption algorithms/check default algorithm OK 28s 136ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 23s 319ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 23s 171ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 23s 243ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 30s 736ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 30s 591ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 171ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 23s 193ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 23s 359ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 23s 179ms
/disk level encryption/comparable performance OK 20m 2s
/disk level encryption/comparable part sizes OK 49s 394ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 24s 739ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 24s 653ms
/disk level encryption/wide and compact formats OK 1m 12s
/disk level encryption/wide and compact formats/check only compact format OK 23s 835ms
/disk level encryption/wide and compact formats/check only wide format OK 24s 363ms
/disk level encryption/wide and compact formats/check wide and compact format OK 24s 476ms
/disk level encryption/multi disk volume OK 3m 34s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 23s 577ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 23s 992ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 23s 698ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 23s 850ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 23s 630ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 23s 728ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 23s 940ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 23s 930ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 23s 869ms
/disk level encryption/multi volume policy OK 9m 23s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 336ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 23s 684ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 110ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 23s 825ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 23s 847ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 27s 639ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 27s 914ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 27s 740ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 27s 949ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 27s 766ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 27s 485ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 27s 732ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 27s 984ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 27s 320ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 27s 567ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 27s 915ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 27s 725ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 27s 964ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 27s 902ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 27s 449ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 27s 856ms
/disk level encryption/missing key OK 39s 269ms
/disk level encryption/missing key/changed key OK 19s 774ms
/disk level encryption/missing key/missing key OK 19s 493ms
/disk level encryption/merge parts OK 11m 45s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 3s
/disk level encryption/merge parts/optimize table a lot of keys OK 10m 41s
/disk level encryption/invalid current key id OK 27s 481ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 648ms
/disk level encryption/invalid current key id/empty current key id OK 13s 831ms
/disk level encryption/multiple keys OK 2m 14s
/disk level encryption/multiple keys/default current key id OK 36s 737ms
/disk level encryption/multiple keys/hex key conflict OK 12s 907ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 914ms
/disk level encryption/multiple keys/invalid key id OK 13s 917ms
/disk level encryption/multiple keys/mixed formats OK 28s 228ms
/disk level encryption/multiple keys/parts with different keys OK 28s 833ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 593us
/disk level encryption/valid path OK 36s 600ms
/disk level encryption/valid path/path ascii OK 12s 276ms
/disk level encryption/valid path/path nested OK 12s 126ms
/disk level encryption/valid path/path utf8 OK 12s 196ms
/disk level encryption/invalid path OK 25s 796ms
/disk level encryption/invalid path/invalid long path OK 12s 914ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 12s 880ms
/disk level encryption/sanity OK 115ms
/disk level encryption/sanity/select 1 OK 115ms
/disk level encryption/operations OK 9m 10s
/disk level encryption/operations/alter move multi volume policy OK 2m 48s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 24s 145ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 23s 914ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 23s 674ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 24s 395ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 24s 271ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 24s 253ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 24s 74ms
/disk level encryption/operations/alter move multi disk volume OK 1m 36s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 24s 75ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 24s 184ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 23s 973ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 24s 367ms
/disk level encryption/operations/insert and select OK 4m 44s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 23s 79ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 22s 395ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 2s 797ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 350ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 22s 713ms
/disk level encryption/operations/insert and select/check insert back to back OK 601ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 2s 50ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 18s 436ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 18s 393ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 3s 648ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 3s 820ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 14s 586ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 39s 463ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 39s 749ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 36s 904ms
/disk level encryption/key formats OK 48s 45ms
/disk level encryption/key formats/ascii OK 12s 30ms
/disk level encryption/key formats/hexadecimal OK 12s 60ms
/disk level encryption/key formats/special xml symbols OK 12s 95ms
/disk level encryption/key formats/utf-8 OK 11s 857ms
/disk level encryption/encryption at rest OK 10m 5s
/disk level encryption/encryption at rest/corner case check XFail 10m 5s

Generated by TestFlows Open-Source Test Framework v1.9.221228.1171522