Document status - Public
Copyright 2024, Altinity Inc. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc.
(c) 2024 Altinity Inc. All Rights Reserved.
Status: Vitaliy Zakaznikov
Reviewed by: vzakaznikov@altinity.com
Date: Tue Oct 22 11:52:59 AM -05 2024
Stage | Status | Note |
---|---|---|
ClickHouse Server | Pass | LOW: 13, MEDIUM: 10 |
ClickHouse Keeper | Pass | UNKNOWN: 1 |
Stage | Status | Note |
---|---|---|
Integration | Pass | |
Stateful | Pass | |
Stateless | Pass | with known fails. |
Aes Encryption | Pass | |
Aggregate Functions | Pass | |
Atomic Insert | Pass | |
Base58 | Pass | |
ClickHouse Keeper | Pass | |
Data Types | Pass | |
DateTime64 Extended Range | Pass | |
Disk Level Encryption | Pass | |
DNS | Pass | |
Engines | Pass | |
Example | Pass | |
Extended Precision Data Types | Pass | |
Kafka | Pass | |
Kerberos | Pass | |
Key Value | Pass | |
Lightweight Delete | Pass | |
Memory | Pass | |
Part Moves Between Shards | Pass | |
RBAC | Pass | with known fails. |
Parquet | Pass | |
Parquet AWS | Pass | |
Parquet Minio | Pass | |
Selects | Pass | |
Session Timezone | Pass | |
SSL Server | Pass | |
Tiered Storage | Pass | |
Window Functions | Pass | |
Alter Replace | Pass | |
Alter Attach | Pass | |
Alter Move | Pass | with known fails. |
Benchmark Minio | Pass | |
Benchmark AWS | Pass | |
Benchmark GCS | Pass | |
ClickHouse Keeper SSL | Pass | |
LDAP Authentication | Pass | |
LDAP External User Directory | Pass | |
LDAP Role Mapping | Pass | |
S3 Minio | Pass | |
S3 AWS | Pass | |
S3 GCS | Pass | |
Tiered Storage Minio | Pass | |
Tiered Storage AWS | Pass | |
Tiered Storage GCS | Pass |
Stage | Status | Note |
---|---|---|
Asan Integration | Pass | |
Asan Analyzer Integration | Pass | with known fails. |
Asan Stateful | Pass | |
Asan Stateless | Pass | with known fails. |
Asan Stress | Pass | with known fails. |
Msan Stateful | Pass | |
Msan Stateless | Pass | with known fails. |
Msan Stress | Pass | |
Tsan Integration | Pass | |
Tsan Stateful | Pass | |
Tsan Stateless | Pass | with known fails. |
Tsan Stress | Pass | |
UBsan Stateful | Pass | |
UBsan Stateless | Pass | with known fails. |
UBsan Stress | Pass | |
Debug Stateful | Pass | |
Debug Stateless | Pass | with known fails. |
Debug Stress | Pass | with known fails. |
Stage | Status | Note |
---|---|---|
Stateful | Pass | |
Stateless | Pass | with known fails. |
Aes Encryption | Pass | |
Aggregate Functions | Pass | |
Atomic Insert | Pass | |
Base58 | Pass | |
ClickHouse Keeper | Pass | |
Data Types | Pass | |
DateTime64 Extended Range | Pass | |
Disk Level Encryption | Pass | |
DNS | Pass | |
Engines | Pass | |
Example | Pass | |
Extended Precision Data Types | Pass | |
Kafka | Pass | |
Kerberos | Pass | |
Key Value | Pass | |
Lightweight Delete | Pass | |
Memory | Pass | |
Part Moves Between Shards | Pass | |
RBAC | Pass | with known fails. |
Parquet | Pass | |
Parquet AWS | Pass | |
Parquet Minio | Pass | |
Selects | Pass | |
Session Timezone | Pass | |
SSL Server | Pass | |
Tiered Storage | Pass | |
Window Functions | Pass | |
Alter Replace | Pass | |
Alter Attach | Pass | with known fails. |
Alter Move | Pass | |
Benchmark Minio | Pass | |
Benchmark AWS | Pass | |
Benchmark GCS | Pass | |
ClickHouse Keeper SSL | Pass | |
LDAP Authentication | Pass | |
LDAP External User Directory | Pass | |
LDAP Role Mapping | Pass | |
S3 Minio | Pass | with known fails. |
S3 AWS | Pass | |
S3 GCS | Pass | |
Tiered Storage Minio | Pass | with known fails. |
Tiered Storage AWS | Pass | |
Tiered Storage GCS | Pass |
Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1506372082
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/11448615924
GitHub Commit https://github.com/Altinity/ClickHouse/commit/46d4f9bd6a40e43bf5543be25cc704364e0c737b
Results
- Release Trivy
- Release Scout
- Release Grype
- Aarch64 Trivy
- Aarch64 Scout
- Aarch64 Grype
LOW
1. CVE-2013-4235
2. CVE-2016-20013
3. CVE-2016-2781
4. CVE-2017-11164
5. CVE-2021-46848
6. CVE-2022-3219
7. CVE-2022-41409
8. CVE-2023-26604
9. CVE-2023-29383
10. CVE-2023-45918
11. CVE-2023-50495
12. CVE-2023-7008
13. CVE-2024-9143
MEDIUM
1. CVE-2022-44010
2. CVE-2022-44011
3. CVE-2023-4039
4. CVE-2023-47118
5. CVE-2023-48298
6. CVE-2023-48704
7. CVE-2021-31879
8. CVE-2024-2236
9. CVE-2024-6873
10. CVE-2024-22412
Results
- Release Trivy
- Release Scout
- Release Grype
- Aarch64 Trivy
- Aarch64 Scout
- Aarch64 Grype
UNKNOWN
1. CVE-2024-9143
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_6.html
Results
Results
Fails
Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.
Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 AWS
- S3 GCS
- Tiered Storage Minio
- Tiered Storage AWS
- Tiered Storage GCS
Fails
Test: RBAC
Comment: Flaky..
Status: OK to fail.
Test: Alter Move
Comment: Flaky.
Status: OK to fail.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_4.html
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_6.html
Fails
Test: test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.
Test: test_mysql_database_engine/test.py::test_mysql_ddl_for_mysql_database
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
Comment: Pass, error in log parsing.
Status: Pass.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/asan/stress_results.html
Comment: Known fail.
Status: OK to fail.
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_6.html
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Results
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_4.html
Fails
Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
Comment: Known fail.
Status: Known fail.
Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Results
Results
Comment: Flaky. Status: OK to fail.
Results
Results
Fails
Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key
is disabled.
Status: OK to fail.
Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.
Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.
Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.
Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 AWS
- S3 GCS
- Tiered Storage AWS
- Tiered Storage GCS
Fails:
Test: RBAC
Comment: Flaky.
Status: OK to fail.
Test: Alter Attach
Comment: Flaky.
Status: OK to fail.
Test: S3 Minio
Comment: Flaky.
Status: OK to fail.
Test: Tiered Storage Minio
Comment: Flaky.
Status: OK to fail.