Document status - Public


QA Software Build Report

ClickHouse v21.3.20.2 / x86_64

(c) 2022 Altinity Inc. All Rights Reserved.

Approval

Status: Approved for release

Reviewed by: shernandez@altinity.com

Date: 10 Feb 2022

Test Results

Stage Status
FastTest Pass
Integration Fail
Stateful Pass
Stateless Fail
Stress Pass
TestFlows Pass

Test Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v21.3.20.2/x86_64/tests/

Results Analysis

Integration Results Analysis

Tests failing because of issues with docker-compose.yml files from upstream.

Stateless Results Analysis

Test: 02125_dict_get_type_nullable_fix
Reason: missing dictionary, 02125_test_dictionary not found: While processing dictGet('02125_test_dictionary', 'value', toUInt64(0))
Comment: Debugging why dict was not created, query seems ok
Status: After review from DEV team, fail is low risk, test was not run in upstream


Test: 01598_memory_limit_zeros
Reason: unexpected result, The query succeeded but the server error '241' was expected.
Comment: requires further debug
Status: After review from DEV team, fail is low risk, test seems to be setting a lower value and is not working


Test: 01293_show_clusters
Reason: unexpected result but false negative
Comment: test could be updated, we are using IPV4 and test expects IPv6 output
test_shard_localhost 1 1 1 localhost ::1 9000 1
test_shard_localhost 1 1 1 localhost 127.0.0.1 9000 1
Status: False Negative


Test: 01268_procfs_metrics
Reason: result differs with reference
Comment: different results
[bash] 2022-02-07 22:46:19 @@ -1,2 +1 @@
[bash] 2022-02-07 22:46:19 -1
[bash] 2022-02-07 22:46:19 Test OK
[bash] 2022-02-07 22:46:19
Status: After review from DEV team, fail is caused by env config depending on ProcFS


Test: 01193_metadata_loading
Reason: result differs with reference
Comment: metadata looks similar but required further analysis
[bash] 2022-02-07 22:48:37 1000 0 2020-06-25 hello [1,2] [3,4]
[bash] 2022-02-07 22:48:37 1000 1 2020-06-26 word [10,20] [30,40]
[bash] 2022-02-07 22:48:37 -ok
[bash] 2022-02-07 22:48:37 +[6296,4163,4646,2600,1160]
[bash] 2022-02-07 22:48:37 8000 0 2020-06-25 hello [1,2] [3,4]
[bash] 2022-02-07 22:48:37 8000 1 2020-06-26 word [10,20] [30,40]
Status: After review from DEV team, fail is caused by queries running lower than expected, considered a test issue


Test: 01018_Distributed__shard_num
Reason: Unexpected result but false negative
Comment: test could be updated, we are using IPV4 and test expects IPv6 output
[bash] 2022-02-07 23:00:18 -1 10 localhost ::1 9000
[bash] 2022-02-07 23:00:18 -1 20 localhost ::1 9000
[bash] 2022-02-07 23:00:18 +1 10 localhost 127.0.0.1 9000
[bash] 2022-02-07 23:00:18 +1 20 localhost 127.0.0.1 9000
Status: False Negative