Aes Encryption Test Run Report

DateMay 25, 2023 17:30
Duration10m 44s
Framework TestFlows 1.9.230315.1003122

Artifacts

Test artifacts can be found at https://altinity-test-reports.s3.amazonaws.com/index.html#clickhouse/22.8.15.25.altinityfips/5080932159/testflows/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
version22.8.15.25.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash63a15b5dfc55badefcf4b869296e3ec99ca08141
job.id5080932159
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/5080932159
archx86_64
stressFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/22.8/ef5580902f444e6a5d617e7c7a6e8d7a1f5fc9fb/package_release/clickhouse-common-static_22.8.15.25.altinityfips_amd64.deb
collect_service_logsTrue

Summary

77.6%OK
22.4%Known

Statistics

Units OK Fail Error XFail XError
Suites
13
13
Features
13
13
Scenarios
68
67
1
Examples
5728
4425
1237
66
Steps
53651
52013
1572
66

Known Fails

Test NameResultMessage
/aes encryption/compatibility/select/decrypt uniqueXFail 866ms
https://github.com/ClickHouse/ClickHouse/issues/18249
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/aes_encryption/../aes_encryption/tests/compatibility/feature.py", line 14, in feature
    Feature(run=load("aes_encryption.tests.compatibility.select", "feature"), flags=TE)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/aes_encryption/../aes_encryption/tests/compatibility/select.py", line 229, in feature
    Scenario(run=scenario, flags=TE)
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/aes_encryption/../aes_encryption/tests/compatibility/select.py", line 180, in decrypt_unique
    encrypted_secret = node.query(
  File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/aes_encryption/../helpers/cluster.py", line 760, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 22.8.15):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: Invalid mode: aes-128-cfb128: While processing hex(encrypt('aes-128-cfb128', 'secret', '1111111111111111')). (BAD_ARGUMENTS)
(query: SELECT hex(encrypt('aes-128-cfb128', 'secret', '1111111111111111'))
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/aes_encryption/../helpers/cluster.py', line 760 in 'query'

752\|                  assert message in r.output, error(r.output)
753\|  
754\|          if not ignore_exception:
755\|              if message is None or "Exception:" not in message:
756\|                  with Then("check if output has exception") if steps else NullStep():
757\|                      if "Exception:" in r.output:
758\|                          if raise_on_exception:
759\|                              raise QueryRuntimeException(r.output)
760\|>                         assert False, error(r.output)
761\|  
762\|          return r
763\|

Results

Test Name Result Duration
/aes encryption OK 10m 44s
/aes encryption/encrypt OK 1m 58s
/aes encryption/encrypt/aad parameter types and length OK 3s 511ms
/aes encryption/decrypt OK 4m 6s
/aes encryption/decrypt/aad parameter types and length OK 3s 514ms
/aes encryption/encrypt_mysql OK 1m 57s
/aes encryption/encrypt_mysql/encryption OK 1m 49s
/aes encryption/decrypt_mysql OK 3m 28s
/aes encryption/decrypt_mysql/decryption OK 1m 50s
/aes encryption/compatibility OK 6m 54s
/aes encryption/compatibility/insert OK 1m 40s
/aes encryption/compatibility/insert/aes decrypt mysql using input table function OK 16s 421ms
/aes encryption/encrypt/encryption OK 1m 45s
/aes encryption/decrypt/decryption OK 1m 45s
/aes encryption/compatibility/insert/aes decrypt mysql using materialized view OK 119ms
/aes encryption/compatibility/insert/aes encrypt mysql using input table function OK 13s 457ms
/aes encryption/compatibility/insert/aes encrypt mysql using materialized view OK 21s 164ms
/aes encryption/compatibility/insert/decrypt using input table function OK 14s 724ms
/aes encryption/compatibility/insert/decrypt using materialized view OK 139ms
/aes encryption/compatibility/insert/encrypt using input table function OK 14s 955ms
/aes encryption/compatibility/insert/encrypt using materialized view OK 19s 288ms
/aes encryption/compatibility/select OK 44s 716ms
/aes encryption/compatibility/select/decrypt OK 15s 391ms
/aes encryption/encrypt/invalid key or iv length for gcm OK 842ms
/aes encryption/decrypt/invalid ciphertext OK 59s 175ms
/aes encryption/encrypt_mysql/invalid parameters OK 1s 102ms
/aes encryption/encrypt/invalid key or iv length for mode non gcm OK 4s 784ms
/aes encryption/encrypt_mysql/invalid plaintext data type OK 1s 983ms
/aes encryption/decrypt_mysql/invalid ciphertext OK 52s 630ms
/aes encryption/encrypt_mysql/iv parameter types OK 356ms
/aes encryption/encrypt_mysql/key or iv length for mode OK 3s 168ms
/aes encryption/encrypt/invalid parameters OK 1s 422ms
/aes encryption/compatibility/select/decrypt multiple OK 28s 439ms
/aes encryption/encrypt_mysql/key parameter types OK 313ms
/aes encryption/encrypt/invalid plaintext data type OK 1s 779ms
/aes encryption/encrypt_mysql/mode parameter types OK 197ms
/aes encryption/encrypt_mysql/return value OK 125ms
/aes encryption/encrypt_mysql/syntax OK 73ms
/aes encryption/encrypt_mysql/unsupported modes OK 454ms
/aes encryption/encrypt/iv parameter types OK 318ms
/aes encryption/encrypt/key parameter types OK 277ms
/aes encryption/encrypt/mode parameter types OK 114ms
/aes encryption/encrypt/return value OK 158ms
/aes encryption/encrypt/syntax OK 62ms
/aes encryption/compatibility/select/decrypt unique XFail 866ms
/aes encryption/compatibility/mysql OK 4m 29s
/aes encryption/compatibility/mysql/table engine OK 1m 26s
/aes encryption/compatibility/mysql/table engine/decrypt OK 43s 863ms
/aes encryption/decrypt_mysql/invalid parameters OK 1s 100ms
/aes encryption/decrypt_mysql/iv parameter types OK 334ms
/aes encryption/decrypt_mysql/key or iv length for mode OK 2s 410ms
/aes encryption/decrypt_mysql/key parameter types OK 300ms
/aes encryption/decrypt_mysql/mismatched iv OK 1s 371ms
/aes encryption/decrypt/invalid key or iv length for gcm OK 1s 280ms
/aes encryption/decrypt_mysql/mismatched key OK 2s 510ms
/aes encryption/decrypt/invalid key or iv length for mode non gcm OK 3s 894ms
/aes encryption/decrypt_mysql/mismatched mode OK 36s 757ms
/aes encryption/decrypt/invalid parameters OK 1s 360ms
/aes encryption/decrypt/iv parameter types OK 297ms
/aes encryption/decrypt/key parameter types OK 284ms
/aes encryption/decrypt/mismatched aad OK 207ms
/aes encryption/decrypt/mismatched iv OK 1s 312ms
/aes encryption/decrypt/mismatched key OK 2s 327ms
/aes encryption/decrypt/mismatched mode OK 1m 7s
/aes encryption/compatibility/mysql/table engine/encrypt OK 42s 310ms
/aes encryption/decrypt_mysql/mode parameter types OK 131ms
/aes encryption/decrypt_mysql/return value OK 127ms
/aes encryption/decrypt_mysql/syntax OK 65ms
/aes encryption/decrypt_mysql/unsupported modes OK 395ms
/aes encryption/compatibility/mysql/database engine OK 1m 23s
/aes encryption/compatibility/mysql/database engine/decrypt OK 41s 799ms
/aes encryption/decrypt/mode parameter types OK 133ms
/aes encryption/decrypt/return value OK 132ms
/aes encryption/decrypt/syntax OK 65ms
/aes encryption/compatibility/mysql/database engine/encrypt OK 42s 165ms
/aes encryption/compatibility/mysql/table function OK 57s 513ms
/aes encryption/compatibility/mysql/table function/decrypt OK 28s 38ms
/aes encryption/compatibility/mysql/table function/encrypt OK 29s 474ms
/aes encryption/compatibility/mysql/dictionary OK 41s 484ms
/aes encryption/compatibility/mysql/dictionary/decrypt OK 40s 542ms
/aes encryption/compatibility/mysql/dictionary/parameter values OK 940ms

Generated by TestFlows Open-Source Test Framework v1.9.230315.1003122