Document status - Confidential


Disk Level Encryption Test Run Report

DateSep 16, 2022 21:10
Duration1h 5m
Framework TestFlows 1.9.220810.1192506

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3041775518/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.3.10.24
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3041775518
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3041775518
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse

Tags

altinity-docker-runner

Summary

98.5%OK
1.5%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
31
31
Features
31
31
Scenarios
140
137
2
1
Checks
3
3
Steps
24031
24029
2

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 12s 397ms
not supported
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 75, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py", line 653, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.3.10):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO 4cb98250_35f3_11ed_a9a2_0242ac110003 VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../helpers/cluster.py', line 653 in 'query'

645\|              ) if steps else NullStep():
646\|                  assert message in r.output, error(r.output)
647\|  
648\|          if message is None or "Exception:" not in message:
649\|              with Then("check if output has exception") if steps else NullStep():
650\|                  if "Exception:" in r.output:
651\|                      if raise_on_exception:
652\|                          raise QueryRuntimeException(r.output)
653\|>                     assert False, error(r.output)
654\|  
655\|          return r
656\|
/disk level encryption/wide access permission/wide permissionXFail 24s 215ms
not implemented
AssertionError
Traceback (most recent call last):
  File "regression/disk_level_encryption/regression.py", line 124, in 
    regression()
  File "regression/disk_level_encryption/regression.py", line 81, in regression
    Feature(
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/builds/altinity-qa/clickhouse/cicd/release/regression/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 567us
https://github.com/ClickHouse/ClickHouse/issues/29072
None

Results

Test Name Result Duration
/disk level encryption OK 1h 5m
/disk level encryption/memory disk OK 12s 398ms
/disk level encryption/memory disk/memory disk XFail 12s 397ms
/disk level encryption/column ttl OK 43s 824ms
/disk level encryption/column ttl/column ttl delete OK 21s 897ms
/disk level encryption/column ttl/column ttl move OK 21s 925ms
/disk level encryption/encrypted disk OK 11s 402ms
/disk level encryption/encrypted disk/encrypted disk OK 11s 401ms
/disk level encryption/application of changes OK 11s 722ms
/disk level encryption/application of changes/application of changes OK 11s 721ms
/disk level encryption/wide access permission OK 24s 216ms
/disk level encryption/wide access permission/wide permission XFail 24s 215ms
/disk level encryption/no rights OK 2m 1s
/disk level encryption/no rights/changing rights many small inserts OK 1m 0s
/disk level encryption/no rights/changing rights one large insert OK 1m 0s
/disk level encryption/no rights/no rights OK 1s 76ms
/disk level encryption/new directories OK 12s 428ms
/disk level encryption/new directories/new directories OK 12s 427ms
/disk level encryption/invalid disk OK 39s 636ms
/disk level encryption/invalid disk/disk not exist OK 12s 518ms
/disk level encryption/invalid disk/parameter is empty OK 13s 583ms
/disk level encryption/invalid disk/parameter is missing OK 13s 533ms
/disk level encryption/distributed table OK 9m 48s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 35s 606ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 35s 588ms
/disk level encryption/distributed table/distributed table replicated one key OK 35s 473ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 35s 630ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 35s 705ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 39s 676ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 39s 665ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 39s 651ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 39s 681ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 39s 638ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 41s 697ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 43s 726ms
/disk level encryption/distributed table/distributed table sharded one key OK 41s 680ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 43s 797ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 41s 696ms
/disk level encryption/replicated table OK 4m 31s
/disk level encryption/replicated table/replicated table one encrypted replica OK 42s 647ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 42s 470ms
/disk level encryption/replicated table/replicated table one key OK 1m 5s
/disk level encryption/replicated table/replicated table three different keys OK 1m 6s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 53s 659ms
/disk level encryption/invalid key size OK 1m 47s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 525ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 526ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 521ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 511ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 516ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 516ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 525ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 518ms
/disk level encryption/encryption algorithms OK 5m 30s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 28s 977ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 29s 31ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 28s 986ms
/disk level encryption/encryption algorithms/check default algorithm OK 26s 376ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 21s 647ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 21s 667ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 21s 696ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 29s 44ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 28s 961ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 29s 43ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 21s 713ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 21s 618ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 21s 666ms
/disk level encryption/comparable performance OK 19s 204ms
/disk level encryption/comparable performance/check comparable performance OK 19s 203ms
/disk level encryption/comparable part sizes OK 45s 158ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 22s 633ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 22s 523ms
/disk level encryption/wide and compact formats OK 1m 7s
/disk level encryption/wide and compact formats/check only compact format OK 22s 321ms
/disk level encryption/wide and compact formats/check only wide format OK 22s 378ms
/disk level encryption/wide and compact formats/check wide and compact format OK 22s 339ms
/disk level encryption/multi disk volume OK 3m 17s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 21s 925ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 22s 9ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 21s 965ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 22s 39ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 21s 918ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 21s 949ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 21s 925ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 21s 956ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 21s 931ms
/disk level encryption/multi volume policy OK 8m 33s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 22s 43ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 22s 98ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 22s 52ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 22s 146ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 22s 43ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 25s 212ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 25s 187ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 25s 184ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 25s 204ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 25s 166ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 25s 178ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 25s 138ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 25s 269ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 25s 249ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 25s 167ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 25s 267ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 25s 179ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 25s 240ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 25s 175ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 25s 258ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 25s 128ms
/disk level encryption/missing key OK 37s 572ms
/disk level encryption/missing key/changed key OK 18s 760ms
/disk level encryption/missing key/missing key OK 18s 811ms
/disk level encryption/merge parts OK 11m 7s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 59s 295ms
/disk level encryption/merge parts/optimize table a lot of keys OK 10m 7s
/disk level encryption/invalid current key id OK 27s 56ms
/disk level encryption/invalid current key id/current key id not refer OK 13s 538ms
/disk level encryption/invalid current key id/empty current key id OK 13s 516ms
/disk level encryption/multiple keys OK 2m 7s
/disk level encryption/multiple keys/default current key id OK 35s 228ms
/disk level encryption/multiple keys/hex key conflict OK 12s 502ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 517ms
/disk level encryption/multiple keys/invalid key id OK 13s 525ms
/disk level encryption/multiple keys/mixed formats OK 26s 240ms
/disk level encryption/multiple keys/parts with different keys OK 26s 370ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 567us
/disk level encryption/valid path OK 34s 215ms
/disk level encryption/valid path/path ascii OK 11s 372ms
/disk level encryption/valid path/path nested OK 11s 437ms
/disk level encryption/valid path/path utf8 OK 11s 404ms
/disk level encryption/invalid path OK 26s 63ms
/disk level encryption/invalid path/invalid long path OK 12s 534ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 527ms
/disk level encryption/sanity OK 109ms
/disk level encryption/sanity/select 1 OK 108ms
/disk level encryption/operations OK 8m 14s
/disk level encryption/operations/alter move multi volume policy OK 2m 36s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 22s 411ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 22s 333ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 22s 258ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 22s 327ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 22s 328ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 22s 329ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 22s 346ms
/disk level encryption/operations/alter move multi disk volume OK 1m 29s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 22s 280ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 22s 285ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 22s 328ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 22s 275ms
/disk level encryption/operations/insert and select OK 4m 9s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 20s 807ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 20s 823ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 3s 252ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 21s 97ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 20s 899ms
/disk level encryption/operations/insert and select/check insert back to back OK 478ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 1s 329ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 11s 181ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 11s 75ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 2s 667ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 2s 636ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 13s 280ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 37s 131ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 36s 885ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 33s 679ms
/disk level encryption/key formats OK 45s 685ms
/disk level encryption/key formats/ascii OK 11s 421ms
/disk level encryption/key formats/hexadecimal OK 11s 414ms
/disk level encryption/key formats/special xml symbols OK 11s 386ms
/disk level encryption/key formats/utf-8 OK 11s 461ms
/disk level encryption/encryption at rest OK 11s 458ms
/disk level encryption/encryption at rest/corner case check OK 11s 457ms

Generated by TestFlows Open-Source Test Framework v1.9.220810.1192506