Document status - Confidential


Disk Level Encryption Test Run Report

DateOct 04, 2022 17:55
Duration1h 10m
Framework TestFlows 1.9.220810.1192506

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3125479609/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.3.12.20
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3125479609
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3125479609
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse

Tags

altinity-docker-runner

Summary

98.5%OK
1.5%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
31
31
Features
31
31
Scenarios
140
137
2
1
Checks
3
3
Steps
24014
24012
2

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 17s 299ms
not supported
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 75, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.12):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO 32572206_43fd_11ed_b6c7_0242ac110003 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/disk level encryption/wide access permission/wide permissionXFail 24s 788ms
not implemented
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 81, in regression
    Feature(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 1ms
https://github.com/ClickHouse/ClickHouse/issues/29072
None

Results

Test Name Result Duration
/disk level encryption OK 1h 10m
/disk level encryption/memory disk OK 17s 301ms
/disk level encryption/memory disk/memory disk XFail 17s 299ms
/disk level encryption/column ttl OK 49s 485ms
/disk level encryption/column ttl/column ttl delete OK 26s 466ms
/disk level encryption/column ttl/column ttl move OK 23s 17ms
/disk level encryption/encrypted disk OK 11s 907ms
/disk level encryption/encrypted disk/encrypted disk OK 11s 906ms
/disk level encryption/application of changes OK 12s 265ms
/disk level encryption/application of changes/application of changes OK 12s 264ms
/disk level encryption/wide access permission OK 24s 788ms
/disk level encryption/wide access permission/wide permission XFail 24s 788ms
/disk level encryption/no rights OK 2m 3s
/disk level encryption/no rights/changing rights many small inserts OK 1m 1s
/disk level encryption/no rights/changing rights one large insert OK 1m 1s
/disk level encryption/no rights/no rights OK 1s 144ms
/disk level encryption/new directories OK 13s 65ms
/disk level encryption/new directories/new directories OK 13s 62ms
/disk level encryption/invalid disk OK 40s 101ms
/disk level encryption/invalid disk/disk not exist OK 12s 753ms
/disk level encryption/invalid disk/parameter is empty OK 13s 722ms
/disk level encryption/invalid disk/parameter is missing OK 13s 622ms
/disk level encryption/distributed table OK 10m 44s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 39s 626ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 39s 849ms
/disk level encryption/distributed table/distributed table replicated one key OK 37s 613ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 40s 41ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 40s 171ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 43s 544ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 43s 917ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 43s 695ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 43s 701ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 43s 631ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 45s 821ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 45s 860ms
/disk level encryption/distributed table/distributed table sharded one key OK 45s 843ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 45s 808ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 45s 850ms
/disk level encryption/replicated table OK 4m 54s
/disk level encryption/replicated table/replicated table one encrypted replica OK 45s 710ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 47s 326ms
/disk level encryption/replicated table/replicated table one key OK 1m 12s
/disk level encryption/replicated table/replicated table three different keys OK 1m 9s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 58s 409ms
/disk level encryption/invalid key size OK 1m 48s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 870ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 754ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 815ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 801ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 12s 917ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 793ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 986ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 848ms
/disk level encryption/encryption algorithms OK 5m 45s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 30s 149ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 30s 69ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 30s 360ms
/disk level encryption/encryption algorithms/check default algorithm OK 27s 531ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 22s 613ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 22s 834ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 22s 665ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 30s 547ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 30s 55ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 30s 322ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 22s 578ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 22s 884ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 22s 852ms
/disk level encryption/comparable performance OK 21s 538ms
/disk level encryption/comparable performance/check comparable performance OK 21s 535ms
/disk level encryption/comparable part sizes OK 47s 777ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 23s 929ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 23s 846ms
/disk level encryption/wide and compact formats OK 1m 10s
/disk level encryption/wide and compact formats/check only compact format OK 23s 397ms
/disk level encryption/wide and compact formats/check only wide format OK 23s 998ms
/disk level encryption/wide and compact formats/check wide and compact format OK 23s 457ms
/disk level encryption/multi disk volume OK 3m 27s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 23s 274ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 22s 736ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 22s 599ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 23s 216ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 23s 148ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 23s 100ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 23s 169ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 23s 268ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 23s 243ms
/disk level encryption/multi volume policy OK 8m 57s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 23s 196ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 23s 84ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 23s 181ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 22s 916ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 23s 4ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 26s 710ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 26s 55ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 26s 486ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 26s 521ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 25s 794ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 26s 543ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 26s 672ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 26s 625ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 26s 254ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 25s 711ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 26s 362ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 26s 482ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 26s 617ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 26s 89ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 26s 648ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 26s 592ms
/disk level encryption/missing key OK 39s 154ms
/disk level encryption/missing key/changed key OK 19s 556ms
/disk level encryption/missing key/missing key OK 19s 596ms
/disk level encryption/merge parts OK 11m 36s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 2s
/disk level encryption/merge parts/optimize table a lot of keys OK 10m 33s
/disk level encryption/invalid current key id OK 26s 740ms
/disk level encryption/invalid current key id/current key id not refer OK 12s 914ms
/disk level encryption/invalid current key id/empty current key id OK 13s 824ms
/disk level encryption/multiple keys OK 2m 11s
/disk level encryption/multiple keys/default current key id OK 36s 738ms
/disk level encryption/multiple keys/hex key conflict OK 12s 924ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 50ms
/disk level encryption/multiple keys/invalid key id OK 13s 720ms
/disk level encryption/multiple keys/mixed formats OK 27s 634ms
/disk level encryption/multiple keys/parts with different keys OK 27s 598ms
/disk level encryption/default path OK 3ms
/disk level encryption/default path/default path XError 1ms
/disk level encryption/valid path OK 35s 737ms
/disk level encryption/valid path/path ascii OK 11s 935ms
/disk level encryption/valid path/path nested OK 12s 11ms
/disk level encryption/valid path/path utf8 OK 11s 788ms
/disk level encryption/invalid path OK 26s 738ms
/disk level encryption/invalid path/invalid long path OK 12s 832ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 904ms
/disk level encryption/sanity OK 114ms
/disk level encryption/sanity/select 1 OK 114ms
/disk level encryption/operations OK 8m 49s
/disk level encryption/operations/alter move multi volume policy OK 2m 43s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 23s 488ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 23s 183ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 23s 654ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 23s 113ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 23s 368ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 23s 502ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 23s 575ms
/disk level encryption/operations/alter move multi disk volume OK 1m 33s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 23s 558ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 23s 375ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 23s 319ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 23s 432ms
/disk level encryption/operations/insert and select OK 4m 31s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 22s 147ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 22s 120ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 3s 132ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 22s 395ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 22s 240ms
/disk level encryption/operations/insert and select/check insert back to back OK 493ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 1s 775ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 14s 451ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 13s 826ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 3s 272ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 3s 114ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 14s 531ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 39s 354ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 39s 151ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 37s 16ms
/disk level encryption/key formats OK 47s 576ms
/disk level encryption/key formats/ascii OK 12s 54ms
/disk level encryption/key formats/hexadecimal OK 11s 922ms
/disk level encryption/key formats/special xml symbols OK 11s 798ms
/disk level encryption/key formats/utf-8 OK 11s 798ms
/disk level encryption/encryption at rest OK 12s 1ms
/disk level encryption/encryption at rest/corner case check OK 12s 0ms

Generated by TestFlows Open-Source Test Framework v1.9.220810.1192506