Document status - Public

Copyright 2024, Altinity Inc. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc.

QA Software Build Report

ClickHouse v24.3.12.76.altinitystable

(c) 2024 Altinity Inc. All Rights Reserved.

Approval

Status: Approved for release

Reviewed by: vzakaznikov@altinity.com

Date: Wed Nov 6 09:05:10 AM -05 2024

Table of Contents

Test Results

CVE Scan Results

Stage Status Note
ClickHouse Server Pass NEGLIGIBLE: 3, LOW: 15, MEDIUM: 5
ClickHouse Keeper Pass UNKNOWN: 1

x86_64 Results

Stage Status Note
Integration Pass with known fails.
Stateful Pass
Stateless Pass
Aes Encryption Pass
Aggregate Functions Pass
Atomic Insert Pass
Base58 Pass
ClickHouse Keeper Pass
Data Types Pass
DateTime64 Extended Range Pass
Disk Level Encryption Pass
DNS Pass
Engines Pass
Example Pass
Extended Precision Data Types Pass
Kafka Pass
Kerberos Pass
Key Value Pass
Lightweight Delete Pass
Memory Pass
Part Moves Between Shards Pass
RBAC Pass
Parquet Pass
Parquet AWS Pass
Parquet Minio Pass
Selects Pass
Session Timezone Pass
SSL Server Pass with known fails.
Tiered Storage Pass
Window Functions Pass
Alter Replace Pass
Alter Attach Pass
Alter Move Pass
Benchmark Minio Pass
Benchmark AWS Pass
Benchmark GCS Pass
ClickHouse Keeper SSL Pass with known fails.
LDAP Authentication Pass
LDAP External User Directory Pass
LDAP Role Mapping Pass
S3 Minio Pass
S3 AWS Pass with known fails.
S3 GCS Pass
Tiered Storage Minio Pass with known fails.
Tiered Storage AWS Pass with known fails.
Tiered Storage GCS Pass with known fails.

Sanitizer Results

Stage Status Note
Asan Integration Pass with known fails.
Asan Analyzer Integration Pass with known fails.
Asan Stateful Pass
Asan Stateless Pass with known fails.
Asan Stress Pass with known fails.
Msan Stateful Pass
Msan Stateless Pass with known fails.
Msan Stress Pass
Tsan Integration Pass with known fails.
Tsan Stateful Pass
Tsan Stateless Pass
Tsan Stress Pass
UBsan Stateful Pass
UBsan Stateless Pass
UBsan Stress Pass
Debug Stateful Pass
Debug Stateless Pass
Debug Stress Pass with known fails.

Aarch64 Results

Stage Status Note
Stateful Pass
Stateless Pass
Aes Encryption Pass
Aggregate Functions Pass
Atomic Insert Pass
Base58 Pass
ClickHouse Keeper Pass
Data Types Pass
DateTime64 Extended Range Pass
Disk Level Encryption Pass
DNS Pass
Engines Pass
Example Pass
Extended Precision Data Types Pass
Kafka Pass
Kerberos Pass
Key Value Pass
Lightweight Delete Pass
Memory Pass with known fails.
Part Moves Between Shards Pass
RBAC Pass
Parquet Pass
Parquet AWS Pass
Parquet Minio Pass
Selects Pass
Session Timezone Pass
SSL Server Pass with known fails.
Tiered Storage Pass
Window Functions Pass
Alter Replace Pass
Alter Attach Pass
Alter Move Pass
Benchmark Minio Pass
Benchmark AWS Pass
Benchmark GCS Pass
ClickHouse Keeper SSL Pass with known fails.
LDAP Authentication Pass
LDAP External User Directory Pass
LDAP Role Mapping Pass
S3 Minio Pass
S3 AWS Pass with known fails.
S3 GCS Pass
Tiered Storage Minio Pass with known fails.
Tiered Storage AWS Pass with known fails.
Tiered Storage GCS Pass with known fails.

Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1528790411
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/11672696143
GitHub Commit https://github.com/Altinity/ClickHouse/commit/5b67ba5a4febfa774d6373929d551c6a697d7d92

Results Analysis

CVE Scans

ClickHouse Server

Results
- Release Scout
- Release Grype
- Release Trivy
- Aarch64 Scout
- Aarch64 Grype
- Aarch64 Trivy

Negligible (3)
- CVE-2016-20013
- CVE-2017-11164
- CVE-2024-26458

Low (15)
- CVE-2016-2781
- CVE-2021-46848
- CVE-2022-27943
- CVE-2022-3219
- CVE-2022-41409
- CVE-2022-4899
- CVE-2023-29383
- CVE-2023-45918
- CVE-2023-50495
- CVE-2023-7008
- CVE-2024-41996
- CVE-2024-9143
- CVE-2024-26461

Medium (5)
- CVE-2021-31879
- CVE-2023-4039
- CVE-2024-10041
- CVE-2024-2236
- CVE-2024-26462

ClickHouse Keeper

Results
- Release Scout
- Release Grype
- Release Trivy
- Aarch64 Scout
- Aarch64 Grype
- Aarch64 Trivy

Unknown (1)
- CVE-2024-9143

x86_64

Release

Release Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_4.html

Fails

Test: test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Test: test_postgresql_replica_database_engine_2/test.py::test_quoting_publication
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/release/integration_results_3.html
Comment: Known fail.
Status: Ok to Fail.

Release Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/amd64/stateful_results.html

Release Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/amd64/stateless_results.html

Release Regression

Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- RBAC
- Selects
- Session Timezone
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 GCS

Fails

Test: SSL Server
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495151126
Status: Fixed.

Test: ClickHouse Keeper SSL
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495143788
Status: Fixed.

Test: S3 AWS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495151449
Status: Fixed.

Test: Tiered Storage Minio
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495152745
Status: Fixed.

Test: Tiered Storage AWS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495153452
Status: Fixed.

Test: Tiered Storage GCS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495153858
Status: Fixed.

Asan

Asan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_4.html

Fails

Test: test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Test: test_postgresql_replica_database_engine_2/test.py::test_quoting_publication
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan/integration_results_3.html
Comment: Known fail.
Status: Ok to Fail.

Asan Analyzer Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_6.html

Fails

Test: test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Test: test_postgresql_replica_database_engine_2/test.py::test_quoting_publication
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Asan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/asan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/asan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/asan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/asan/stateless_results_4.html

Fails

Test: 02700_s3_part_INT_MAX
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/asan/stateless_results_3.html
Comment: Memory limit exceeded
Status: OK to fail

Asan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/asan/stateful_results.html

Asan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stress/asan/stress_results.html
Comment: Known fail.
Status: OK to fail.

Msan

Msan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_6.html

Fails

Test: 01603_read_with_backoff_bug
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/msan/stateless_results_5.html
Comment: Known fail
Status: OK to fail.

Msan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/msan/stateful_results.html

Msan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stress/msan/stress_results.html

Tsan

Tsan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_6.html

Fails

Test: test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Test: test_postgresql_replica_database_engine_2/test.py::test_quoting_publication
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Tsan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/tsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/tsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/tsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/tsan/stateless_results_4.html

Tsan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/tsan/stateful_results.html

Tsan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stress/tsan/stress_results.html

UBsan

UBsan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/ubsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/ubsan/stateless_results_2.html

UBsan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/ubsan/stateful_results.html

UBsan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stress/ubsan/stress_results.html

Debug

Debug Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/debug/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/debug/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/debug/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/debug/stateless_results_4.html

Debug Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/debug/stateful_results.html

Debug Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stress/debug/stress_results.html
Comment: Known fail.
Status: OK to fail.

Aarch64

Aarch64 Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateful/aarch64/stateful_results.html

Aarch64 Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v24.3.12.76.altinitystable/2024-11-05T22-20-36.761/stateless/aarch64/stateless_results.html

Aarch64 Regression

Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Part Moves Between Shards
- RBAC
- Selects
- Session Timezone
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 GCS

Fails

Test: Memory
Comment: Known fail.
Status: OK to fail.

Test: SSL Server
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495099589
Status: OK to fail.

Test: ClickHouse Keeper SSL
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495086164
Status: Fixed.

Test: S3 AWS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495098173
Status: Fixed.

Test: Tiered Storage Minio
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495100570
Status: Fixed.

Test: Tiered Storage AWS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495100900
Status: Fixed.

Test: Tiered Storage GCS
Comment: Green run https://github.com/Altinity/ClickHouse/actions/runs/11669912384/job/32495101212
Status: Fixed.