Document status - Public
Copyright 2024, Altinity Inc. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc.
(c) 2024 Altinity Inc. All Rights Reserved.
Status: Approved for release
Reviewed by: vzakaznikov@altinity.com
Date: Tue Dec 17 08:58:05 AM -05 2024
Stage | Status | Note |
---|---|---|
ClickHouse Server | Pass | LOW: 12, MEDIUM: 13, NEGLIGIBLE: 2 |
ClickHouse Server Alpine | Pass | |
ClickHouse Keeper | Pass |
Stage | Status | Note |
---|---|---|
Integration | Pass | |
Stateful | Pass | |
Stateless | Pass | |
Aes Encryption | Pass | |
Aggregate Functions | Pass | |
Atomic Insert | Pass | |
Base58 | Pass | |
ClickHouse Keeper | Pass | |
Data Types | Pass | |
DateTime64 Extended Range | Pass | |
Disk Level Encryption | Pass | |
DNS | Pass | |
Engines | Pass | |
Example | Pass | |
Extended Precision Data Types | Pass | |
Kafka | Pass | |
Kerberos | Pass | |
Key Value | Pass | |
Lightweight Delete | Pass | |
Memory | Pass | |
Part Moves Between Shards | Pass | |
RBAC | Pass | |
Parquet | Pass | |
Parquet AWS | Pass | |
Parquet Minio | Pass | |
Selects | Pass | |
Session Timezone | Pass | |
SSL Server | Pass | |
Tiered Storage | Pass | |
Window Functions | Pass | |
Alter Replace | Pass | |
Alter Attach | Pass | |
Alter Move | Pass | |
Benchmark Minio | Pass | |
Benchmark AWS | Pass | |
Benchmark GCS | Pass | |
ClickHouse Keeper SSL | Pass | |
LDAP Authentication | Pass | |
LDAP External User Directory | Pass | |
LDAP Role Mapping | Pass | |
S3 Minio | Pass | |
S3 AWS | Pass | |
S3 GCS | Pass | |
Tiered Storage Minio | Pass | |
Tiered Storage AWS | Pass | |
Tiered Storage GCS | Pass |
Stage | Status | Note |
---|---|---|
Asan Integration | Pass | |
Asan Analyzer Integration | Pass | with known fails. |
Asan Stateful | Pass | |
Asan Stateless | Pass | with known fails. |
Asan Stress | Pass | with known fails. |
Msan Stateful | Pass | |
Msan Stateless | Pass | with known fails. |
Msan Stress | Pass | |
Tsan Integration | Pass | |
Tsan Stateful | Pass | |
Tsan Stateless | Pass | with known fails. |
Tsan Stress | Pass | |
UBsan Stateful | Pass | |
UBsan Stateless | Pass | with known fails. |
UBsan Stress | Pass | |
Debug Stateful | Pass | |
Debug Stateless | Pass | with known fails. |
Debug Stress | Pass |
Stage | Status | Note |
---|---|---|
Stateful | Pass | |
Stateless | Pass | |
Aes Encryption | Pass | |
Aggregate Functions | Pass | |
Atomic Insert | Pass | |
Base58 | Pass | |
ClickHouse Keeper | Pass | |
Data Types | Pass | |
DateTime64 Extended Range | Pass | |
Disk Level Encryption | Pass | |
DNS | Pass | |
Engines | Pass | |
Example | Pass | |
Extended Precision Data Types | Pass | |
Kafka | Pass | |
Kerberos | Pass | |
Key Value | Pass | |
Lightweight Delete | Pass | |
Memory | Pass | |
Part Moves Between Shards | Pass | |
RBAC | Pass | |
Parquet | Pass | |
Parquet AWS | Pass | |
Parquet Minio | Pass | |
Selects | Pass | |
Session Timezone | Pass | |
SSL Server | Pass | |
Tiered Storage | Pass | |
Window Functions | Pass | |
Alter Replace | Pass | |
Alter Attach | Pass | |
Alter Move | Pass | |
Benchmark Minio | Pass | |
Benchmark AWS | Pass | |
Benchmark GCS | Pass | |
ClickHouse Keeper SSL | Pass | |
LDAP Authentication | Pass | |
LDAP External User Directory | Pass | |
LDAP Role Mapping | Pass | |
S3 Minio | Pass | |
S3 AWS | Pass | |
S3 GCS | Pass | |
Tiered Storage Minio | Pass | |
Tiered Storage AWS | Pass | |
Tiered Storage GCS | Pass |
Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1591728135
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/12361559082
GitHub Commit https://github.com/Altinity/ClickHouse/commit/b53fc9f68f30219552c427c7d7d451342728b9a4
Results
- Release Grype
- Aarch64 Grype
Low (12 CVEs)
1. CVE-2013-4235
2. CVE-2016-2781
3. CVE-2021-46848
4. CVE-2022-3219
5. CVE-2022-41409
6. CVE-2023-26604
7. CVE-2023-29383
8. CVE-2023-45918
9. CVE-2023-50495
10. CVE-2023-7008
11. CVE-2024-2236
12. CVE-2024-9143
Medium (13 CVEs)
1. CVE-2021-31879
2. CVE-2022-44010
3. CVE-2022-44011
4. CVE-2023-4039
5. CVE-2023-47118
6. CVE-2023-48298
7. CVE-2023-48704
8. CVE-2024-10041
9. CVE-2024-10524
10. CVE-2024-10963
11. CVE-2024-22412
12. CVE-2024-41436
13. CVE-2024-6873
Negligible (2 CVEs)
1. CVE-2016-20013
2. CVE-2017-11164
Results
- Grype
Results
- Release Grype
- Aarch64 Grype
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/release/integration_results_6.html
Results
Results
Fails
Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.
Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 AWS
- S3 GCS
- Tiered Storage Minio
- Tiered Storage AWS
- Tiered Storage GCS
Fails
Test: RBAC
Comment: Green run - https://github.com/Altinity/clickhouse-regression/actions/runs/12365489274
Status: OK.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan/integration_results_4.html
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_6.html
Fails
Test: test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.
Test: test_mysql_database_engine/test.py::test_mysql_ddl_for_mysql_database
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/asan_analyzer/integration_results_1.html
Comment: Pass, error in log parsing.
Status: Pass.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/asan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stress/asan/stress_results.html
Comment: Known fail.
Status: OK to fail.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/integration/tsan/integration_results_6.html
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/tsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/ubsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.43.altinitystable/2024-12-17T02-56-29.206/stateless/debug/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Comment: Flaky. Status: OK to fail.
Results
Results
Fails
Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.
Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 AWS
- S3 GCS
- Tiered Storage Minio
- Tiered Storage AWS
- Tiered Storage GCS
Fails:
Test: RBAC
Comment: Green run - https://github.com/Altinity/clickhouse-regression/actions/runs/12365813124
Status: OK.