Document status - Public

Copyright 2022, Altinity Inc. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc.

QA Software Build Report

ClickHouse 21.1.11.3 / x86_64

(c) 2022 Altinity Inc. All Rights Reserved.

Approval

Status: Approved for release by QA [vzakaznikov@altinity.com Fri 10 Jun 2022 12:14:49 PM EDT]

Reviewed by: azvonov@altinity.com

Date: 10 June 2022

Table of Contents

Test Results

Stage Status
FastTest Pass
Integration Fail
Stateful Pass
Stateless Pass
Stress Pass
TestFlows Pass

Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/
Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/559802203

Results Analysis

Fast tests Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/fast_tests/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/fast_tests/nice.log.txt

Integration Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/integration/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/integration/nice.log.txt

Test: /integration/test_http_handlers_config∕test.py::test_predefined_query_handler
Reason: 

2h 10m        [bash] ________________________ test_predefined_query_handler _________________________
2h 10m        [bash]
2h 10m        [bash]     def test_predefined_query_handler():
2h 10m        [bash]         with contextlib.closing(
2h 10m        [bash]                 SimpleCluster(ClickHouseCluster(__file__), "predefined_handler", "test_predefined_handler")) as cluster:
2h 10m        [bash]             assert 404 == cluster.instance.http_request('?max_threads=1', method='GET', headers={'XXX': 'xxx'}).status_code
2h 10m        [bash]
2h 10m        [bash]             assert 404 == cluster.instance.http_request('test_predefined_handler_get?max_threads=1', method='GET',
2h 10m        [bash]                                                         headers={'XXX': 'bad'}).status_code
2h 10m        [bash]
2h 10m        [bash]             assert 404 == cluster.instance.http_request('test_predefined_handler_get?max_threads=1', method='POST',
2h 10m        [bash]                                                         headers={'XXX': 'xxx'}).status_code
2h 10m        [bash]
2h 10m        [bash]             assert 500 == cluster.instance.http_request('test_predefined_handler_get?max_threads=1', method='GET',
2h 10m        [bash]                                                         headers={'XXX': 'xxx'}).status_code
2h 10m        [bash]
2h 10m        [bash] >           assert b'max_threads\t1\n' == cluster.instance.http_request(
2h 10m        [bash]                 'test_predefined_handler_get?max_threads=1&setting_name=max_threads', method='GET',
2h 10m        [bash]                 headers={'XXX': 'xxx'}).content
2h 10m        [bash] E           assert b'max_threads\t1\n' == b"max_threads\t\\'auto(1)\\'\n"
2h 10m        [bash] E             At index 12 diff: b'1' != b'\\'
2h 10m        [bash] E             Full diff:
2h 10m        [bash] E             - b"max_threads\t\\'auto(1)\\'\n"
2h 10m        [bash] E             + b'max_threads\t1\n'
2h 10m        [bash]
2h 10m        [bash] test_http_handlers_config/test.py:57: AssertionError

Comment:
Status: FAIL

Stateful Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stateful/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stateful/nice.log.txt

Stress Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stress/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stress/nice.log.txt

TestFlows Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/testflows/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/testflows/raw.log

Comments:
The following fails need further investigation:

✘ [ XFail ] /clickhouse/rbac/privileges/alter fetch/table_type='ReplicatedMergeTree-sharded_cluster'/FETCH PARTITION/user with direct privilege ᐅ 21.1 fail - needs to be investigated
✘ [ XFail ] /clickhouse/rbac/privileges/alter fetch/table_type='ReplicatedMergeTree-sharded_cluster'/FETCH PARTITION/user with privilege via role ᐅ 21.1 fail - needs to be investigated
✘ [ XFail ] /clickhouse/rbac/privileges/alter fetch/table_type='ReplicatedMergeTree-sharded_cluster'/ALTER FETCH PARTITION/user with direct privilege ᐅ 21.1 fail - needs to be investigated
✘ [ XFail ] /clickhouse/rbac/privileges/alter fetch/table_type='ReplicatedMergeTree-sharded_cluster'/ALTER FETCH PARTITION/user with privilege via role ᐅ 21.1 fail - needs to be investigated

Stateless Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stateless/results.html
Log file https://altinity-test-reports.s3.amazonaws.com/builds/stable/v21.1.11.3/2022-06-09T13-12-27.754/stateless/nice.log.txt

The following 5 tests are FLAKY:

Test: /stateless/01701_parallel_parsing_infinite_segmentation
Reason: 

583us     ⟥⟤ Fail 01701_parallel_parsing_infinite_segmentation, /stateless/01701_parallel_parsing_infinite_segmentation
1m 31s        [bash] 2022-06-10 12:53:06 01701_parallel_parsing_infinite_segmentation:                           [ FAIL ] 0.21 sec. - result differs with reference:
1m 31s        [bash] 2022-06-10 12:53:06 --- /usr/share/clickhouse-test/queries/0_stateless/01701_parallel_parsing_infinite_segmentation.reference  2022-06-10 11:45:24.000000000 +0300
1m 31s        [bash] 2022-06-10 12:53:06 +++ /tmp/clickhouse-test/0_stateless/01701_parallel_parsing_infinite_segmentation.stdout   2022-06-10 12:53:06.061443646 +0300
1m 31s        [bash] 2022-06-10 12:53:06 @@ -1 +1 @@
1m 31s        [bash] 2022-06-10 12:53:06 -Ok.
1m 31s        [bash] 2022-06-10 12:53:06 +FAIL
1m 31s        [bash] 2022-06-10 12:53:06

Comment:
Status: FLAKY

Test: /stateless/01532_primary_key_without_order_by_zookeeper
Reason: 

567us     ⟥⟤ Fail 01532_primary_key_without_order_by_zookeeper, /stateless/01532_primary_key_without_order_by_zookeeper
5m 39s        [bash] 2022-06-10 12:57:14 01532_primary_key_without_order_by_zookeeper:                           [ FAIL ] 0.25 sec. - result differs with reference:
5m 39s        [bash] 2022-06-10 12:57:14 --- /usr/share/clickhouse-test/queries/0_stateless/01532_primary_key_without_order_by_zookeeper.reference  2022-06-10 11:45:24.000000000 +0300
5m 39s        [bash] 2022-06-10 12:57:14 +++ /tmp/clickhouse-test/0_stateless/01532_primary_key_without_order_by_zookeeper.stdout   2022-06-10 12:57:14.179723151 +0300
5m 39s        [bash] 2022-06-10 12:57:14 @@ -9,8 +9,8 @@
5m 39s        [bash] 2022-06-10 12:57:14  1 c
5m 39s        [bash] 2022-06-10 12:57:14  2 b
5m 39s        [bash] 2022-06-10 12:57:14  1 c   0
5m 39s        [bash] 2022-06-10 12:57:14 -2 e   555
5m 39s        [bash] 2022-06-10 12:57:14  2 b   0
5m 39s        [bash] 2022-06-10 12:57:14 +2 e   555
5m 39s        [bash] 2022-06-10 12:57:14  CREATE TABLE default.merge_tree_pk_sql\n(\n    `key` UInt64,\n    `value` String,\n    `key2` UInt64\n)\nENGINE = ReplacingMergeTree\nPRIMARY KEY key\nORDER BY (key, key2)\nSETTINGS index_granularity = 8192
5m 39s        [bash] 2022-06-10 12:57:14  CREATE TABLE default.replicated_merge_tree_pk_sql\n(\n    `key` UInt64,\n    `value` String\n)\nENGINE = ReplicatedReplacingMergeTree(\'/clickhouse/test/01532_primary_key_without\', \'r1\')\nPRIMARY KEY key\nORDER BY key\nSETTINGS index_granularity = 8192
5m 39s        [bash] 2022-06-10 12:57:14  1 a
5m 39s        [bash] 2022-06-10 12:57:14 @@ -18,6 +18,6 @@
5m 39s        [bash] 2022-06-10 12:57:14  1 c
5m 39s        [bash] 2022-06-10 12:57:14  2 b
5m 39s        [bash] 2022-06-10 12:57:14  1 c   0
5m 39s        [bash] 2022-06-10 12:57:14 -2 e   555
5m 39s        [bash] 2022-06-10 12:57:14  2 b   0
5m 39s        [bash] 2022-06-10 12:57:14 +2 e   555
5m 39s        [bash] 2022-06-10 12:57:14  CREATE TABLE default.replicated_merge_tree_pk_sql\n(\n    `key` UInt64,\n    `value` String,\n    `key2` UInt64\n)\nENGINE = ReplicatedReplacingMergeTree(\'/clickhouse/test/01532_primary_key_without\', \'r1\')\nPRIMARY KEY key\nORDER BY (key, key2)\nSETTINGS index_granularity = 8192
5m 39s        [bash] 2022-06-10 12:57:14

Comment:
Status: FLAKY

Test: /stateless/01091_num_threads
Reason: 

707us     ⟥⟤ Fail 01091_num_threads, /stateless/01091_num_threads
18m 48s        [bash] 2022-06-10 13:10:22 01091_num_threads:                                                      [ FAIL ] 0.20 sec. - result differs with reference:
18m 48s        [bash] 2022-06-10 13:10:22 --- /usr/share/clickhouse-test/queries/0_stateless/01091_num_threads.reference    2022-06-10 11:45:24.000000000 +0300
18m 48s        [bash] 2022-06-10 13:10:22 +++ /tmp/clickhouse-test/0_stateless/01091_num_threads.stdout 2022-06-10 13:10:22.918291103 +0300
18m 48s        [bash] 2022-06-10 13:10:22 @@ -3,4 +3,4 @@
18m 48s        [bash] 2022-06-10 13:10:22  499999500000
18m 48s        [bash] 2022-06-10 13:10:22  1
18m 48s        [bash] 2022-06-10 13:10:22  499999500000
18m 48s        [bash] 2022-06-10 13:10:22 -1
18m 48s        [bash] 2022-06-10 13:10:22 +0
18m 48s        [bash] 2022-06-10 13:10:22

Comment:
Status: FLAKY

Test: /stateless/01045_order_by_pk_special_storages
Reason: 

564us     ⟥⟤ Fail 01045_order_by_pk_special_storages, /stateless/01045_order_by_pk_special_storages
21m 15s        [bash] 2022-06-10 13:12:50 01045_order_by_pk_special_storages:                                     [ FAIL ] 0.68 sec. - result differs with reference:
21m 15s        [bash] 2022-06-10 13:12:50 --- /usr/share/clickhouse-test/queries/0_stateless/01045_order_by_pk_special_storages.reference   2022-06-10 11:45:24.000000000 +0300
21m 15s        [bash] 2022-06-10 13:12:50 +++ /tmp/clickhouse-test/0_stateless/01045_order_by_pk_special_storages.stdout    2022-06-10 13:12:50.330688740 +0300
21m 15s        [bash] 2022-06-10 13:12:50 @@ -1,9 +1,9 @@
21m 15s        [bash] 2022-06-10 13:12:50  ---StorageMerge---
21m 15s        [bash] 2022-06-10 13:12:50 -0
21m 15s        [bash] 2022-06-10 13:12:50 -0
21m 15s        [bash] 2022-06-10 13:12:50 -0
21m 15s        [bash] 2022-06-10 13:12:50 -0
21m 15s        [bash] 2022-06-10 13:12:50 -0
21m 15s        [bash] 2022-06-10 13:12:50 +2
21m 15s        [bash] 2022-06-10 13:12:50 +2
21m 15s        [bash] 2022-06-10 13:12:50 +2
21m 15s        [bash] 2022-06-10 13:12:50 +2
21m 15s        [bash] 2022-06-10 13:12:50 +2
21m 15s        [bash] 2022-06-10 13:12:50  0    0
21m 15s        [bash] 2022-06-10 13:12:50  0    10000
21m 15s        [bash] 2022-06-10 13:12:50  0    1000000
21m 15s        [bash] 2022-06-10 13:12:50

Comment:
Status: FLAKY

Test: /stateless/00717_merge_and_distributed
Reason: 

546us     ⟥⟤ Fail 00717_merge_and_distributed, /stateless/00717_merge_and_distributed
32m 49s        [bash] 2022-06-10 13:24:23 00717_merge_and_distributed:                                            [ FAIL ] 0.12 sec. - return code 10
32m 49s        [bash] 2022-06-10 13:24:23 Expected error code: 16 but got: 10.
32m 49s        [bash] 2022-06-10 13:24:23 Received exception from server (version 21.1.11):
32m 49s        [bash] 2022-06-10 13:24:23 Code: 10. DB::Exception: Received from localhost:9000. DB::Exception: Not found column _table in block: while executing 'INPUT : 0 -> _table String : 0'.
32m 49s        [bash] 2022-06-10 13:24:23
32m 49s        [bash] 2022-06-10 13:24:23 , result:
32m 49s        [bash] 2022-06-10 13:24:23
32m 49s        [bash] 2022-06-10 13:24:23 --------------Single Local------------
32m 49s        [bash] 2022-06-10 13:24:23 2018-08-01    100
32m 49s        [bash] 2022-06-10 13:24:23 2018-08-01    100 test_local_1
32m 49s        [bash] 2022-06-10 13:24:23 100   test_local_1
32m 49s        [bash] 2022-06-10 13:24:23 2018-08-01    100
32m 49s        [bash] 2022-06-10 13:24:23

Comment:
Status: FLAKY