Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Disk Level Encryption Test Run Report

DateMay 25, 2023 18:24
Duration1h 51m
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinityfips/5080932159/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
version22.8.15.25.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63a15b5dfc55badefcf4b869296e3ec99ca08141
job.id5080932159
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/5080932159
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
collect_service_logsTrue

Summary

98%OK
2%Known

Statistics

Units OK Fail XFail XError
Modules
1
1
Suites
31
31
Features
31
31
Scenarios
139
135
3
1
Checks
3
3
Iterations
50
50
Steps
28739
28730
9

Known Fails

Test NameResultMessage
/disk level encryption/memory disk/memory diskXFail 13s 506ms
not supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 132, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 83, in regression
    Feature(run=load("disk_level_encryption.tests.memory", "feature"))
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 74, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/memory.py", line 60, in memory_disk
    insert_into_table(name=table_name, values=values)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/steps.py", line 201, in insert_into_table
    return node.query(f"INSERT INTO {name} VALUES {values}")
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py", line 760, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.15):
Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: Method reserve is not implemented for memory disks. (NOT_IMPLEMENTED)
(query: INSERT INTO a0ff2248_fb29_11ed_9fd3_772739ccda3a VALUES (1, 'hello'),(2, 'there'))

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../helpers/cluster.py', line 760 in 'query'

752\|                  assert message in r.output, error(r.output)
753\|  
754\|          if not ignore_exception:
755\|              if message is None or "Exception:" not in message:
756\|                  with Then("check if output has exception") if steps else NullStep():
757\|                      if "Exception:" in r.output:
758\|                          if raise_on_exception:
759\|                              raise QueryRuntimeException(r.output)
760\|>                         assert False, error(r.output)
761\|  
762\|          return r
763\|
/disk level encryption/wide access permission/wide permissionXFail 25s 248ms
not implemented
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 132, in 
    regression()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/regression.py", line 89, in regression
    Feature(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 93, in feature
    scenario()
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/disk_level_encryption/../disk_level_encryption/tests/wide_access_permission.py", line 77, in wide_permission
    assert False, "Expected server not to start"
AssertionError: Expected server not to start
/disk level encryption/default path/default pathXError 661us
https://github.com/ClickHouse/ClickHouse/issues/29072
None
/disk level encryption/encryption at rest/corner case checkXFail 10m 6s
https://github.com/ClickHouse/ClickHouse/issues/38381
ClickHouse server is not healthy

Results

Test Name Result Duration
/disk level encryption OK 1h 51m
/disk level encryption/memory disk OK 13s 507ms
/disk level encryption/memory disk/memory disk XFail 13s 506ms
/disk level encryption/column ttl OK 49s 52ms
/disk level encryption/column ttl/column ttl delete OK 24s 390ms
/disk level encryption/column ttl/column ttl move OK 24s 660ms
/disk level encryption/encrypted disk OK 12s 538ms
/disk level encryption/encrypted disk/encrypted disk OK 12s 536ms
/disk level encryption/application of changes OK 13s 165ms
/disk level encryption/application of changes/application of changes OK 13s 164ms
/disk level encryption/wide access permission OK 25s 254ms
/disk level encryption/wide access permission/wide permission XFail 25s 248ms
/disk level encryption/no rights OK 2m 25s
/disk level encryption/no rights/changing rights many small inserts OK 1m 22s
/disk level encryption/no rights/changing rights one large insert OK 1m 2s
/disk level encryption/no rights/no rights OK 1s 139ms
/disk level encryption/new directories OK 13s 561ms
/disk level encryption/new directories/new directories OK 13s 559ms
/disk level encryption/invalid disk OK 40s 844ms
/disk level encryption/invalid disk/disk not exist OK 12s 927ms
/disk level encryption/invalid disk/parameter is empty OK 13s 984ms
/disk level encryption/invalid disk/parameter is missing OK 13s 931ms
/disk level encryption/distributed table OK 11m 22s
/disk level encryption/distributed table/distributed table replicated one encrypted replica OK 40s 412ms
/disk level encryption/distributed table/distributed table replicated one encrypted replica insert into unencrypted OK 42s 409ms
/disk level encryption/distributed table/distributed table replicated one key OK 40s 535ms
/disk level encryption/distributed table/distributed table replicated three different keys OK 42s 424ms
/disk level encryption/distributed table/distributed table replicated two encrypted replica two keys OK 40s 419ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica OK 46s 559ms
/disk level encryption/distributed table/distributed table sharded and replicated one encrypted replica insert into unencrypted OK 48s 643ms
/disk level encryption/distributed table/distributed table sharded and replicated one key OK 46s 425ms
/disk level encryption/distributed table/distributed table sharded and replicated three different keys OK 48s 578ms
/disk level encryption/distributed table/distributed table sharded and replicated two encrypted replica two keys OK 46s 762ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica OK 48s 711ms
/disk level encryption/distributed table/distributed table sharded one encrypted replica insert into unencrypted OK 46s 624ms
/disk level encryption/distributed table/distributed table sharded one key OK 48s 564ms
/disk level encryption/distributed table/distributed table sharded three different keys OK 46s 620ms
/disk level encryption/distributed table/distributed table sharded two encrypted replica two keys OK 48s 630ms
/disk level encryption/replicated table OK 5m 4s
/disk level encryption/replicated table/replicated table one encrypted replica OK 48s 500ms
/disk level encryption/replicated table/replicated table one encrypted replica insert into unencrypted OK 48s 432ms
/disk level encryption/replicated table/replicated table one key OK 1m 13s
/disk level encryption/replicated table/replicated table three different keys OK 1m 13s
/disk level encryption/replicated table/replicated table two encrypted replica two keys OK 1m 0s
/disk level encryption/invalid key size OK 1m 50s
/disk level encryption/invalid key size/check hex invalid key size AES 128 CTR OK 12s 887ms
/disk level encryption/invalid key size/check hex invalid key size AES 192 CTR OK 13s 979ms
/disk level encryption/invalid key size/check hex invalid key size AES 256 CTR OK 13s 923ms
/disk level encryption/invalid key size/check hex invalid key size default OK 13s 947ms
/disk level encryption/invalid key size/check invalid key size AES 128 CTR OK 13s 912ms
/disk level encryption/invalid key size/check invalid key size AES 192 CTR OK 13s 967ms
/disk level encryption/invalid key size/check invalid key size AES 256 CTR OK 13s 940ms
/disk level encryption/invalid key size/check invalid key size default OK 13s 955ms
/disk level encryption/encryption algorithms OK 6m 3s
/disk level encryption/encryption algorithms/check change AES 128 CTR to AES 192 CTR OK 31s 716ms
/disk level encryption/encryption algorithms/check change AES 256 CTR AES 192 CTR OK 31s 606ms
/disk level encryption/encryption algorithms/check change AES 256 CTR to default OK 31s 627ms
/disk level encryption/encryption algorithms/check default algorithm OK 29s 209ms
/disk level encryption/encryption algorithms/check encryption AES 128 CTR OK 24s 42ms
/disk level encryption/encryption algorithms/check encryption AES 192 CTR OK 24s 23ms
/disk level encryption/encryption algorithms/check encryption AES 256 CTR OK 24s 41ms
/disk level encryption/encryption algorithms/check hex change AES 128 CTR to AES 192 CTR OK 31s 721ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to AES 192 CTR OK 31s 595ms
/disk level encryption/encryption algorithms/check hex change AES 256 CTR to default OK 31s 608ms
/disk level encryption/encryption algorithms/check hex encryption AES 128 CTR OK 24s 20ms
/disk level encryption/encryption algorithms/check hex encryption AES 192 CTR OK 24s 116ms
/disk level encryption/encryption algorithms/check hex encryption AES 256 CTR OK 24s 7ms
/disk level encryption/comparable performance OK 26m 4s
/disk level encryption/comparable part sizes OK 52s 415ms
/disk level encryption/comparable part sizes/check comparable part sizes for compact format OK 26s 765ms
/disk level encryption/comparable part sizes/check comparable part sizes for wide format OK 25s 649ms
/disk level encryption/wide and compact formats OK 1m 15s
/disk level encryption/wide and compact formats/check only compact format OK 25s 277ms
/disk level encryption/wide and compact formats/check only wide format OK 25s 507ms
/disk level encryption/wide and compact formats/check wide and compact format OK 25s 114ms
/disk level encryption/multi disk volume OK 3m 41s
/disk level encryption/multi disk volume/multi disk volume three disks one encrypted same key OK 24s 577ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted same key OK 24s 504ms
/disk level encryption/multi disk volume/multi disk volume three disks two encrypted two keys OK 24s 588ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks same key OK 24s 607ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks three keys OK 24s 616ms
/disk level encryption/multi disk volume/multi disk volume three encrypted disks two keys OK 24s 692ms
/disk level encryption/multi disk volume/multi disk volume two disks one encrypted OK 24s 489ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks one key OK 24s 485ms
/disk level encryption/multi disk volume/multi disk volume two encrypted disks two keys OK 24s 474ms
/disk level encryption/multi volume policy OK 10m 13s
/disk level encryption/multi volume policy/multi volume policy four encrypted disks ttl OK 24s 726ms
/disk level encryption/multi volume policy/multi volume policy one encrypted disk ttl OK 24s 792ms
/disk level encryption/multi volume policy/multi volume policy three encrypted disks ttl OK 24s 648ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in different policies ttl OK 24s 773ms
/disk level encryption/multi volume policy/multi volume policy two encrypted disks in one policy ttl OK 24s 764ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk in one two unencrypted in the other OK 30s 640ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each one key OK 30s 495ms
/disk level encryption/multi volume policy/multi volume policy two volumes one encrypted disk one not in each two keys OK 30s 666ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each four keys OK 30s 555ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each one key OK 30s 551ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in different disks OK 30s 574ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each three keys same keys in one volume OK 30s 593ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in one volume OK 30s 783ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys in two volumes OK 30s 839ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in each two keys one key for one volume OK 30s 702ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other one key OK 30s 668ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other three keys OK 30s 554ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys for each volume OK 30s 601ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one one encrypted in the other two keys in one volume OK 30s 558ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other one key OK 30s 645ms
/disk level encryption/multi volume policy/multi volume policy two volumes two encrypted disk in one two unencrypted in the other two keys OK 30s 721ms
/disk level encryption/missing key OK 40s 199ms
/disk level encryption/missing key/changed key OK 20s 85ms
/disk level encryption/missing key/missing key OK 20s 112ms
/disk level encryption/merge parts OK 12m 14s
/disk level encryption/merge parts/merge parts with different encryption keys five keys OK 1m 5s
/disk level encryption/merge parts/optimize table a lot of keys OK 11m 8s
/disk level encryption/invalid current key id OK 26s 829ms
/disk level encryption/invalid current key id/current key id not refer OK 12s 923ms
/disk level encryption/invalid current key id/empty current key id OK 13s 904ms
/disk level encryption/multiple keys OK 2m 17s
/disk level encryption/multiple keys/default current key id OK 37s 900ms
/disk level encryption/multiple keys/hex key conflict OK 12s 896ms
/disk level encryption/multiple keys/hex key id conflict OK 13s 949ms
/disk level encryption/multiple keys/invalid key id OK 13s 915ms
/disk level encryption/multiple keys/mixed formats OK 29s 245ms
/disk level encryption/multiple keys/parts with different keys OK 29s 210ms
/disk level encryption/default path OK 1ms
/disk level encryption/default path/default path XError 661us
/disk level encryption/valid path OK 37s 777ms
/disk level encryption/valid path/path ascii OK 12s 530ms
/disk level encryption/valid path/path nested OK 12s 656ms
/disk level encryption/valid path/path utf8 OK 12s 588ms
/disk level encryption/invalid path OK 26s 866ms
/disk level encryption/invalid path/invalid long path OK 12s 920ms
/disk level encryption/invalid path/invalid path without forward slash in the end OK 13s 944ms
/disk level encryption/sanity OK 231ms
/disk level encryption/sanity/select 1 OK 230ms
/disk level encryption/operations OK 10m 9s
/disk level encryption/operations/alter move multi volume policy OK 2m 56s
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes four encrypted disks OK 25s 248ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk OK 25s 80ms
/disk level encryption/operations/alter move multi volume policy/alter move part multi volume policy two volumes one encrypted disk one not in each one key OK 25s 209ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes four encrypted disks OK 25s 210ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk OK 25s 208ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes one encrypted disk one not in each one key OK 25s 292ms
/disk level encryption/operations/alter move multi volume policy/alter move partition multi volume policy two volumes three encrypted disks OK 25s 183ms
/disk level encryption/operations/alter move multi disk volume OK 1m 40s
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume encrypted and encrypted OK 25s 191ms
/disk level encryption/operations/alter move multi disk volume/alter move part multi disk volume local and encrypted OK 25s 151ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume encrypted and encrypted OK 25s 131ms
/disk level encryption/operations/alter move multi disk volume/alter move partition multi disk volume local and encrypted OK 25s 151ms
/disk level encryption/operations/insert and select OK 5m 32s
/disk level encryption/operations/insert and select/check insert and select one partition one block OK 23s 373ms
/disk level encryption/operations/insert and select/check insert and select one partition ten blocks OK 23s 235ms
/disk level encryption/operations/insert and select/check insert and select ten millions rows OK 4s 15ms
/disk level encryption/operations/insert and select/check insert and select ten partitions one block OK 23s 943ms
/disk level encryption/operations/insert and select/check insert and select three partitions three blocks OK 23s 335ms
/disk level encryption/operations/insert and select/check insert back to back OK 865ms
/disk level encryption/operations/insert and select/check insert incremental block size OK 2s 938ms
/disk level encryption/operations/insert and select/check insert parallel five concurrent hundred ids hundred values partition by id OK 20s 282ms
/disk level encryption/operations/insert and select/check insert parallel five inserts hundred ids hundred values OK 17s 754ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values OK 4s 948ms
/disk level encryption/operations/insert and select/check insert parallel five inserts one id two values partition by id OK 5s 35ms
/disk level encryption/operations/insert and select/check insert with large parts one partition one block OK 16s 881ms
/disk level encryption/operations/insert and select/check insert with large parts one partition ten blocks OK 53s 30ms
/disk level encryption/operations/insert and select/check insert with large parts ten partitions one block OK 51s 734ms
/disk level encryption/operations/insert and select/check insert with large parts three partitions three blocks OK 48s 276ms
/disk level encryption/key formats OK 50s 475ms
/disk level encryption/key formats/ascii OK 12s 608ms
/disk level encryption/key formats/hexadecimal OK 12s 584ms
/disk level encryption/key formats/special xml symbols OK 12s 672ms
/disk level encryption/key formats/utf-8 OK 12s 607ms
/disk level encryption/encryption at rest OK 10m 6s
/disk level encryption/encryption at rest/corner case check XFail 10m 6s

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122