Document status - Confidential


Aes Encryption Test Run Report

DateFeb 10, 2023 19:37
Duration6m 45s
Framework TestFlows 1.9.221228.1171522

Artifacts

Test artifacts can be found at https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850406/artifacts/browse

Attributes

projectaltinity-qa/clickhouse/cicd/release
project.id22089296
user.nameAndrey Zvonov
user.emailzvonov.andrey@gmail.com
version22.8.13.21
repositoryhttps://github.com/Altinity/ClickHouse.git
job.id3752850406
job.urlhttps://gitlab.com/altinity-qa/clickhouse/cicd/release/-/jobs/3752850406
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_path/usr/bin/clickhouse

Tags

altinity-docker-runner

Summary

77.6%OK
22.4%Known

Statistics

Units OK Fail Error XFail XError
Suites
13
13
Features
13
13
Scenarios
68
67
1
Examples
5728
4425
1237
66
Steps
53642
52004
1572
66

Known Fails

Test NameResultMessage
/aes encryption/compatibility/select/decrypt uniqueXFail 790ms
https://github.com/ClickHouse/ClickHouse/issues/18249
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.8/threading.py", line 890, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/aes_encryption/../aes_encryption/tests/compatibility/feature.py", line 14, in feature
    Feature(run=load("aes_encryption.tests.compatibility.select", "feature"), flags=TE)
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/aes_encryption/../aes_encryption/tests/compatibility/select.py", line 229, in feature
    Scenario(run=scenario, flags=TE)
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/aes_encryption/../aes_encryption/tests/compatibility/select.py", line 180, in decrypt_unique
    encrypted_secret = node.query(
  File "/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/aes_encryption/../helpers/cluster.py", line 682, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.13):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: Invalid mode: aes-128-cfb128: While processing hex(encrypt('aes-128-cfb128', 'secret', '1111111111111111')). (BAD_ARGUMENTS)
(query: SELECT hex(encrypt('aes-128-cfb128', 'secret', '1111111111111111'))
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/builds/altinity-qa/clickhouse/cicd/release/scripts/regression/aes_encryption/../helpers/cluster.py', line 682 in 'query'

674\|              ) if steps else NullStep():
675\|                  assert message in r.output, error(r.output)
676\|  
677\|          if message is None or "Exception:" not in message:
678\|              with Then("check if output has exception") if steps else NullStep():
679\|                  if "Exception:" in r.output:
680\|                      if raise_on_exception:
681\|                          raise QueryRuntimeException(r.output)
682\|>                     assert False, error(r.output)
683\|  
684\|          return r
685\|

Results

Test Name Result Duration
/aes encryption OK 6m 45s
/aes encryption/encrypt OK 1m 35s
/aes encryption/encrypt/aad parameter types and length OK 3s 782ms
/aes encryption/decrypt OK 3m 16s
/aes encryption/decrypt/aad parameter types and length OK 3s 758ms
/aes encryption/encrypt_mysql OK 1m 34s
/aes encryption/encrypt_mysql/encryption OK 1m 28s
/aes encryption/decrypt_mysql OK 2m 47s
/aes encryption/decrypt_mysql/decryption OK 1m 27s
/aes encryption/compatibility OK 5m 1s
/aes encryption/compatibility/insert OK 1m 22s
/aes encryption/compatibility/insert/aes decrypt mysql using input table function OK 14s 634ms
/aes encryption/decrypt/decryption OK 1m 23s
/aes encryption/encrypt/encryption OK 1m 23s
/aes encryption/compatibility/insert/aes decrypt mysql using materialized view OK 90ms
/aes encryption/compatibility/insert/aes encrypt mysql using input table function OK 10s 802ms
/aes encryption/compatibility/insert/aes encrypt mysql using materialized view OK 16s 962ms
/aes encryption/compatibility/insert/decrypt using input table function OK 12s 141ms
/aes encryption/compatibility/insert/decrypt using materialized view OK 82ms
/aes encryption/compatibility/insert/encrypt using input table function OK 12s 396ms
/aes encryption/compatibility/insert/encrypt using materialized view OK 15s 834ms
/aes encryption/compatibility/select OK 40s 932ms
/aes encryption/compatibility/select/decrypt OK 12s 564ms
/aes encryption/decrypt/invalid ciphertext OK 49s 261ms
/aes encryption/decrypt_mysql/invalid ciphertext OK 43s 759ms
/aes encryption/encrypt/invalid key or iv length for gcm OK 745ms
/aes encryption/encrypt_mysql/invalid parameters OK 875ms
/aes encryption/encrypt/invalid key or iv length for mode non gcm OK 3s 724ms
/aes encryption/encrypt_mysql/invalid plaintext data type OK 1s 418ms
/aes encryption/encrypt_mysql/iv parameter types OK 221ms
/aes encryption/encrypt_mysql/key or iv length for mode OK 2s 390ms
/aes encryption/encrypt/invalid parameters OK 1s 179ms
/aes encryption/encrypt_mysql/key parameter types OK 253ms
/aes encryption/encrypt/invalid plaintext data type OK 1s 474ms
/aes encryption/encrypt_mysql/mode parameter types OK 143ms
/aes encryption/encrypt_mysql/return value OK 140ms
/aes encryption/encrypt_mysql/syntax OK 64ms
/aes encryption/encrypt_mysql/unsupported modes OK 450ms
/aes encryption/encrypt/iv parameter types OK 291ms
/aes encryption/encrypt/key parameter types OK 222ms
/aes encryption/encrypt/mode parameter types OK 122ms
/aes encryption/encrypt/return value OK 147ms
/aes encryption/encrypt/syntax OK 50ms
/aes encryption/compatibility/select/decrypt multiple OK 27s 576ms
/aes encryption/compatibility/select/decrypt unique XFail 790ms
/aes encryption/compatibility/mysql OK 2m 58s
/aes encryption/compatibility/mysql/table engine OK 1m 1s
/aes encryption/compatibility/mysql/table engine/decrypt OK 32s 705ms
/aes encryption/decrypt_mysql/invalid parameters OK 1s 84ms
/aes encryption/decrypt_mysql/iv parameter types OK 222ms
/aes encryption/decrypt_mysql/key or iv length for mode OK 1s 969ms
/aes encryption/decrypt_mysql/key parameter types OK 246ms
/aes encryption/decrypt_mysql/mismatched iv OK 1s 262ms
/aes encryption/decrypt_mysql/mismatched key OK 1s 919ms
/aes encryption/decrypt/invalid key or iv length for gcm OK 1s 74ms
/aes encryption/decrypt/invalid key or iv length for mode non gcm OK 3s 275ms
/aes encryption/decrypt_mysql/mismatched mode OK 29s 498ms
/aes encryption/decrypt/invalid parameters OK 1s 206ms
/aes encryption/decrypt/iv parameter types OK 222ms
/aes encryption/decrypt/key parameter types OK 302ms
/aes encryption/decrypt/mismatched aad OK 186ms
/aes encryption/decrypt/mismatched iv OK 975ms
/aes encryption/decrypt/mismatched key OK 2s 193ms
/aes encryption/decrypt/mismatched mode OK 50s 877ms
/aes encryption/compatibility/mysql/table engine/encrypt OK 28s 563ms
/aes encryption/decrypt_mysql/mode parameter types OK 82ms
/aes encryption/decrypt_mysql/return value OK 112ms
/aes encryption/decrypt_mysql/syntax OK 42ms
/aes encryption/decrypt_mysql/unsupported modes OK 296ms
/aes encryption/compatibility/mysql/database engine OK 54s 678ms
/aes encryption/compatibility/mysql/database engine/decrypt OK 27s 873ms
/aes encryption/decrypt/mode parameter types OK 121ms
/aes encryption/decrypt/return value OK 91ms
/aes encryption/decrypt/syntax OK 50ms
/aes encryption/compatibility/mysql/database engine/encrypt OK 26s 803ms
/aes encryption/compatibility/mysql/table function OK 35s 121ms
/aes encryption/compatibility/mysql/table function/decrypt OK 17s 195ms
/aes encryption/compatibility/mysql/table function/encrypt OK 17s 925ms
/aes encryption/compatibility/mysql/dictionary OK 26s 918ms
/aes encryption/compatibility/mysql/dictionary/decrypt OK 26s 327ms
/aes encryption/compatibility/mysql/dictionary/parameter values OK 589ms

Generated by TestFlows Open-Source Test Framework v1.9.221228.1171522