Document status - Public

Copyright 2024, Altinity Inc. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc.

QA Software Build Report

ClickHouse v23.3.19.34.altinityfips

(c) 2024 Altinity Inc. All Rights Reserved.

Approval

Status: Approved for release by QA

Reviewed by: vzakaznikov@altinity.com

Date: Thu Mar 21 12:03:58 PM EDT 2024

Table of Contents

Test Results

x86_64

Stage Status Note
Trivy Pass
Scout Pass
Keeper Trivy Pass
Keeper Scout Pass
Integration Pass with known fails.
Stateful Pass
Stateless Pass
Aes Encryption Pass
Aggregate Functions Pass
Alter Pass
Atomic Insert Pass
Base58 Pass
Benchmark AWS Pass
Benchmark Minio Pass
Benchmark GCS Pass
ClickHouse Keeper Pass
ClickHouse Keeper SSL Pass
Data Types Pass
DateTime64 Extended Range Pass
Disk Level Encryption Pass
DNS Pass
Example Pass
Engines Pass
Extended Precision Data Types Pass
Kafka Pass
Kerberos Pass
Key Value Pass
LDAP Authentication Pass
LDAP External User Directory Pass
LDAP Role Mapping Pass
Lightweight Delete Pass
Memory Pass
Parquet Pass
Parquet AWS Pass
Parquet Minio Pass
Part Moves Between Shards Pass
RBAC Pass
Selects Pass
Session Timezone Pass
SSL Server Pass
S3 AWS Pass
S3 Minio Pass
S3 GCS Pass
Tiered Storage Pass
Tiered Storage AWS Pass
Tiered Storage Minio Pass
Tiered Storage GCS Pass
Window Functions Pass
Asan Integration Pass with known fails.
Asan Analyzer Integration Pass with known fails.
Asan Stateful Pass
Asan Stateless Pass
Asan Stress Pass
Msan Stateful Pass
Msan Stateless Pass
Msan Stress Pass
Tsan Integration Pass with known fails.
Tsan Stateful Pass
Tsan Stateless Pass
Tsan Stress Pass
UBsan Stateful Pass
UBsan Stateless Pass
UBsan Stress Pass
Debug Stateful Pass
Debug Stateless Pass
Debug Stress Pass

Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1221424816
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/8247806903

Results Analysis

x86_64

Release

Release Trivy

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/staging-docker-trivy-ubuntu-server-amd64/results.html

Release Scout

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/staging-docker-scout-ubuntu-server-amd64/results.html

Keeper Release Trivy

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/staging-docker-trivy-ubuntu-keeper-amd64/results.html

Keeper Release Scout

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/staging-docker-scout-ubuntu-keeper-amd64/results.html

Release Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_6.html

Fails

Test: test_tlsv1_3/test.py::test_https
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_non_ssl_auth
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_create_user
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_wrong_cert
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_keeper_internal_secure/test.py::test_secure_raft_works
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_4.html
Comment: Known fail.
Status: OK to fail.

Test: test_cgroup_limit/test.py::test_cgroup_cpu_limit
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/release/integration_results_5.html
Comment: Known fail.
Status: OK to fail.

Release Stateful

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateful/amd64/stateful_results.html

Release Stateless

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/amd64/stateless_results.html

Release Regression

Results
- Aes Encryption
- Aggregate Functions
- Alter
- Atomic Insert
- Base58
- Benchmark AWS
- Benchmark Minio
- Benchmark GCS
- ClickHouse Keeper
- ClickHouse Keeper SSL
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Example
- Engines
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Lightweight Delete
- Memory
- Parquet
- Parquet AWS
- Parquet Minio
- Part Moves Between Shards
- RBAC
- Selects
- Session Timezone
- SSL Server
- S3 AWS
- S3 Minio
- S3 GCS
- Tiered Storage
- Tiered Storage AWS
- Tiered Storage Minio
- Tiered Storage GCS
- Window Functions

Fails

Test: Alter
Log: https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/regression/x86_64/alter/report.html
Comment: Known fail.
Status: OK to fail.

Asan

Asan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_4.html

Fails

Test: test_cgroup_limit/test.py::test_cgroup_cpu_limit
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_keeper_internal_secure/test.py::test_secure_raft_works
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_2.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_non_ssl_auth
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_create_user
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_wrong_cert
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan/integration_results_3.html
Comment: Known fail.
Status: OK to fail.

Asan Analyzer Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_6.html

Fails

Test: test_tlsv1_3/test.py::test_https
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_non_ssl_auth
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_create_user
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_wrong_cert
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_keeper_internal_secure/test.py::test_secure_raft_works
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_4.html
Comment: Known fail.
Status: OK to fail.

Test: test_cgroup_limit/test.py::test_cgroup_cpu_limit
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/asan_analyzer/integration_results_5.html
Comment: Known fail.
Status: OK to fail.

Asan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_4.html

Fails

Test: 02920_rename_column_of_skip_indices
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: 02951_parallel_parsing_json_compact_each_row
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/asan/stateless_results_4.html
Comment: Known fail.
Status: OK to fail.

Asan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateful/asan/stateful_results.html

Asan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stress/asan/stress_results.html

Tsan

Tsan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_6.html

Fails

Test: test_tlsv1_3/test.py::test_https
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_non_ssl_auth
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_create_user
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_tlsv1_3/test.py::test_https_wrong_cert
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: test_keeper_internal_secure/test.py::test_secure_raft_works
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_4.html
Comment: Known fail.
Status: OK to fail.

Test: test_cgroup_limit/test.py::test_cgroup_cpu_limit
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/integration/tsan/integration_results_5.html
Comment: Known fail.
Status: OK to fail.

Tsan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_4.html

Fails

Test: 02920_rename_column_of_skip_indices
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: 02951_parallel_parsing_json_compact_each_row
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/tsan/stateless_results_4.html
Comment: Known fail.
Status: OK to fail.

Tsan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateful/tsan/stateful_results.html

Tsan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stress/tsan/stress_results.html

Debug

Debug Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_4.html

Fails

Test: 02920_rename_column_of_skip_indices
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_1.html
Comment: Known fail.
Status: OK to fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_3.html
Comment: Known fail.
Status: OK to fail.

Test: 02951_parallel_parsing_json_compact_each_row
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateless/debug/stateless_results_4.html
Comment: Known fail.
Status: OK to fail.

Debug Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stateful/debug/stateful_results.html

Debug Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.19.34.altinityfips/2024-03-20T21-20-28.907/stress/debug/stress_results.html