Document status - Confidential


Disk Level Encryption Test Run Report

DateJul 19, 2022 14:18
Duration1h 8m
Framework TestFlows 1.9.220712.1163352

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/2739540925/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.3.8.40
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id2739540925
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/2739540925
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse

Tags

altinity-docker-runner

Summary

98.5%OK
1.5%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
30
30
Features
30
30
Scenarios
139
136
2
1
Checks
3
3
Steps
23964
23962
2

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 14s 343ms
not supported
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 120, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 72, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py", line 641, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.8):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO f4463074_075c_11ed_b90c_0242ac110003 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py', line 641 in 'query'

633\|              ) if steps else NullStep():
634\|                  assert message in r.output, error(r.output)
635\|  
636\|          if message is None or "Exception:" not in message:
637\|              with Then("check if output has exception") if steps else NullStep():
638\|                  if "Exception:" in r.output:
639\|                      if raise_on_exception:
640\|                          raise QueryRuntimeException(r.output)
641\|>                     assert False, error(r.output)
642\|  
643\|          return r
644\|
/disk level encryption/wide access permission/wide permissionXFail 24s 535ms
not implemented
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 120, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 78, in regression
    Feature(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 456us
https://github.com/ClickHouse/ClickHouse/issues/29072
None

Results

Test Name Result Duration
/disk level encryption OK 1h 8m
/disk level encryption/memory disk OK 14s 344ms
/disk level encryption/memory disk/memory disk XFail 14s 343ms
/disk level encryption/column ttl OK 47s 591ms
/disk level encryption/column ttl/column ttl delete OK 24s 696ms
/disk level encryption/column ttl/column ttl move OK 22s 893ms
/disk level encryption/encrypted disk OK 11s 684ms
/disk level encryption/encrypted disk/encrypted disk OK 11s 682ms
/disk level encryption/application of changes OK 12s 207ms
/disk level encryption/application of changes/application of changes OK 12s 206ms
/disk level encryption/wide access permission OK 24s 544ms
/disk level encryption/wide access permission/wide permission XFail 24s 535ms
/disk level encryption/no rights OK 2m 2s
/disk level encryption/no rights/changing rights many small inserts OK 1m 0s
/disk level encryption/no rights/changing rights one large insert OK 1m 0s
/disk level encryption/no rights/no rights OK 1s 82ms
/disk level encryption/new directories OK 12s 748ms
/disk level encryption/new directories/new directories OK 12s 746ms
/disk level encryption/invalid disk OK 41s 19ms
/disk level encryption/invalid disk/disk not exist OK 13s 654ms
/disk level encryption/invalid disk/parameter is empty OK 13s 689ms
/disk level encryption/invalid disk/parameter is missing OK 13s 674ms
/disk level encryption/distributed table OK 10m 30s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 37s 946ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 37s 940ms
/disk level encryption/distributed table/distributed table replicated one key OK 38s 114ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 38s 93ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 38s 207ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 41s 639ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 42s 383ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 42s 361ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 42s 311ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 43s 448ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 45s 621ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 45s 703ms
/disk level encryption/distributed table/distributed table sharded one key OK 45s 693ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 45s 682ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 45s 731ms
/disk level encryption/replicated table OK 4m 48s
/disk level encryption/replicated table/replicated table one encrypted replica OK 45s 42ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 46s 606ms
/disk level encryption/replicated table/replicated table one key OK 1m 8s
/disk level encryption/replicated table/replicated table three different keys OK 1m 10s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 58s 427ms
/disk level encryption/invalid key size OK 1m 48s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 13s 654ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 619ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 635ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 616ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 608ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 592ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 645ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 609ms
/disk level encryption/encryption algorithms OK 5m 41s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 29s 946ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 29s 711ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 29s 846ms
/disk level encryption/encryption algorithms/check default algorithm OK 27s 299ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 22s 466ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 22s 586ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 22s 678ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 29s 819ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 29s 969ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 30s 3ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 22s 629ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 22s 528ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 22s 504ms
/disk level encryption/comparable performance OK 21s 688ms
/disk level encryption/comparable performance/check comparable performance OK 21s 687ms
/disk level encryption/comparable part sizes OK 47s 237ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 23s 573ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 23s 662ms
/disk level encryption/wide and compact formats OK 1m 9s
/disk level encryption/wide and compact formats/check only compact format OK 23s 411ms
/disk level encryption/wide and compact formats/check only wide format OK 23s 384ms
/disk level encryption/wide and compact formats/check wide and compact format OK 22s 967ms
/disk level encryption/multi disk volume OK 3m 24s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 22s 825ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 22s 708ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 22s 783ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 22s 965ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 22s 672ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 22s 756ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 22s 792ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 22s 562ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 22s 795ms
/disk level encryption/multi volume policy OK 8m 51s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 22s 885ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 22s 862ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 22s 732ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 22s 816ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 22s 885ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 26s 124ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 26s 111ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 26s 18ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 26s 375ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 26s 161ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 26s 84ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 26s 151ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 26s 98ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 26s 250ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 26s 62ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 26s 50ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 26s 16ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 26s 25ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 26s 111ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 26s 8ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 26s 95ms
/disk level encryption/missing key OK 38s 228ms
/disk level encryption/missing key/changed key OK 19s 127ms
/disk level encryption/missing key/missing key OK 19s 99ms
/disk level encryption/merge parts OK 11m 30s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 1s
/disk level encryption/merge parts/optimize table a lot of keys OK 10m 29s
/disk level encryption/invalid current key id OK 27s 261ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 636ms
/disk level encryption/invalid current key id/empty current key id OK 13s 624ms
/disk level encryption/multiple keys OK 2m 11s
/disk level encryption/multiple keys/default current key id OK 36s 102ms
/disk level encryption/multiple keys/hex key conflict OK 13s 613ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 659ms
/disk level encryption/multiple keys/invalid key id OK 13s 650ms
/disk level encryption/multiple keys/mixed formats OK 27s 162ms
/disk level encryption/multiple keys/parts with different keys OK 27s 221ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 456us
/disk level encryption/valid path OK 35s 151ms
/disk level encryption/valid path/path ascii OK 11s 721ms
/disk level encryption/valid path/path nested OK 11s 687ms
/disk level encryption/valid path/path utf8 OK 11s 741ms
/disk level encryption/invalid path OK 26s 312ms
/disk level encryption/invalid path/invalid long path OK 12s 656ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 654ms
/disk level encryption/sanity OK 104ms
/disk level encryption/sanity/select 1 OK 103ms
/disk level encryption/operations OK 8m 59s
/disk level encryption/operations/alter move multi volume policy OK 2m 42s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 23s 276ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 23s 97ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 23s 276ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 23s 118ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 23s 183ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 23s 110ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 23s 152ms
/disk level encryption/operations/alter move multi disk volume OK 1m 32s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 22s 973ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 23s 76ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 23s 287ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 23s 164ms
/disk level encryption/operations/insert and select OK 4m 44s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 21s 996ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 21s 755ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 3s 645ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 22s 131ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 21s 639ms
/disk level encryption/operations/insert and select/check insert back to back OK 510ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 1s 857ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 17s 224ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 15s 312ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 3s 145ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 3s 119ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 14s 435ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 45s 151ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 41s 504ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 38s 803ms
/disk level encryption/key formats OK 47s 195ms
/disk level encryption/key formats/ascii OK 11s 779ms
/disk level encryption/key formats/hexadecimal OK 11s 818ms
/disk level encryption/key formats/special xml symbols OK 11s 802ms
/disk level encryption/key formats/utf-8 OK 11s 792ms

Generated by TestFlows Open-Source Test Framework v1.9.220712.1163352