Document status - Public


QA Software Build Report

ClickHouse v23.8.16.42.altinitystable

(c) 2024 Altinity Inc. All Rights Reserved.

Approval

Status: Vitaliy Zakaznikov

Reviewed by: vzakaznikov@altinity.com

Date: Tue Oct 22 11:52:59 AM -05 2024

Table of Contents

Test Results

CVE Scan Results

Stage Status Note
ClickHouse Server Pass LOW: 13, MEDIUM: 10
ClickHouse Keeper Pass UNKNOWN: 1

x86_64 Results

Stage Status Note
Integration Pass
Stateful Pass
Stateless Pass with known fails.
Aes Encryption Pass
Aggregate Functions Pass
Atomic Insert Pass
Base58 Pass
ClickHouse Keeper Pass
Data Types Pass
DateTime64 Extended Range Pass
Disk Level Encryption Pass
DNS Pass
Engines Pass
Example Pass
Extended Precision Data Types Pass
Kafka Pass
Kerberos Pass
Key Value Pass
Lightweight Delete Pass
Memory Pass
Part Moves Between Shards Pass
RBAC Pass with known fails.
Parquet Pass
Parquet AWS Pass
Parquet Minio Pass
Selects Pass
Session Timezone Pass
SSL Server Pass
Tiered Storage Pass
Window Functions Pass
Alter Replace Pass
Alter Attach Pass
Alter Move Pass with known fails.
Benchmark Minio Pass
Benchmark AWS Pass
Benchmark GCS Pass
ClickHouse Keeper SSL Pass
LDAP Authentication Pass
LDAP External User Directory Pass
LDAP Role Mapping Pass
S3 Minio Pass
S3 AWS Pass
S3 GCS Pass
Tiered Storage Minio Pass
Tiered Storage AWS Pass
Tiered Storage GCS Pass

Sanitizer Results

Stage Status Note
Asan Integration Pass
Asan Analyzer Integration Pass with known fails.
Asan Stateful Pass
Asan Stateless Pass with known fails.
Asan Stress Pass with known fails.
Msan Stateful Pass
Msan Stateless Pass with known fails.
Msan Stress Pass
Tsan Integration Pass
Tsan Stateful Pass
Tsan Stateless Pass with known fails.
Tsan Stress Pass
UBsan Stateful Pass
UBsan Stateless Pass with known fails.
UBsan Stress Pass
Debug Stateful Pass
Debug Stateless Pass with known fails.
Debug Stress Pass with known fails.

Aarch64 Results

Stage Status Note
Stateful Pass
Stateless Pass with known fails.
Aes Encryption Pass
Aggregate Functions Pass
Atomic Insert Pass
Base58 Pass
ClickHouse Keeper Pass
Data Types Pass
DateTime64 Extended Range Pass
Disk Level Encryption Pass
DNS Pass
Engines Pass
Example Pass
Extended Precision Data Types Pass
Kafka Pass
Kerberos Pass
Key Value Pass
Lightweight Delete Pass
Memory Pass
Part Moves Between Shards Pass
RBAC Pass with known fails.
Parquet Pass
Parquet AWS Pass
Parquet Minio Pass
Selects Pass
Session Timezone Pass
SSL Server Pass
Tiered Storage Pass
Window Functions Pass
Alter Replace Pass
Alter Attach Pass with known fails.
Alter Move Pass
Benchmark Minio Pass
Benchmark AWS Pass
Benchmark GCS Pass
ClickHouse Keeper SSL Pass
LDAP Authentication Pass
LDAP External User Directory Pass
LDAP Role Mapping Pass
S3 Minio Pass with known fails.
S3 AWS Pass
S3 GCS Pass
Tiered Storage Minio Pass with known fails.
Tiered Storage AWS Pass
Tiered Storage GCS Pass

Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1506372082
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/11448615924
GitHub Commit https://github.com/Altinity/ClickHouse/commit/46d4f9bd6a40e43bf5543be25cc704364e0c737b

Results Analysis

CVE Scans

ClickHouse Server

Results
- Release Trivy
- Release Scout
- Release Grype
- Aarch64 Trivy
- Aarch64 Scout
- Aarch64 Grype

LOW
1. CVE-2013-4235
2. CVE-2016-20013
3. CVE-2016-2781
4. CVE-2017-11164
5. CVE-2021-46848
6. CVE-2022-3219
7. CVE-2022-41409
8. CVE-2023-26604
9. CVE-2023-29383
10. CVE-2023-45918
11. CVE-2023-50495
12. CVE-2023-7008
13. CVE-2024-9143

MEDIUM
1. CVE-2022-44010
2. CVE-2022-44011
3. CVE-2023-4039
4. CVE-2023-47118
5. CVE-2023-48298
6. CVE-2023-48704
7. CVE-2021-31879
8. CVE-2024-2236
9. CVE-2024-6873
10. CVE-2024-22412

ClickHouse Keeper

Results
- Release Trivy
- Release Scout
- Release Grype
- Aarch64 Trivy
- Aarch64 Scout
- Aarch64 Grype

UNKNOWN
1. CVE-2024-9143

x86_64

Release

Release Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/release/integration_results_6.html

Release Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/amd64/stateful_results.html

Release Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/amd64/stateless_results.html

Fails

Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.

Release Regression

Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Attach
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 Minio
- S3 AWS
- S3 GCS
- Tiered Storage Minio
- Tiered Storage AWS
- Tiered Storage GCS

Fails

Test: RBAC
Comment: Flaky..
Status: OK to fail.

Test: Alter Move
Comment: Flaky.
Status: OK to fail.

Asan

Asan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan/integration_results_4.html

Asan Analyzer Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_6.html

Fails

Test: test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
Comment: Known fail.
Status: Ok to Fail.

Test: test_mysql_database_engine/test.py::test_mysql_ddl_for_mysql_database
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/asan_analyzer/integration_results_1.html
Comment: Pass, error in log parsing.
Status: Pass.

Asan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_4.html

Fails

Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/asan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Asan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/asan/stateful_results.html

Asan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/asan/stress_results.html
Comment: Known fail.
Status: OK to fail.

Msan

Msan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_4.html

Fails

Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Msan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/msan/stateful_results.html

Msan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/msan/stress_results.html

Tsan

Tsan Integration

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_4.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_5.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/integration/tsan/integration_results_6.html

Tsan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_4.html

Fails

Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/tsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Tsan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/tsan/stateful_results.html

Tsan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/tsan/stress_results.html

UBsan

UBsan Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_4.html

Fails

Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/msan/stateless_results_2.html
Comment: Known fail.
Status: Known fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/ubsan/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

UBsan Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/ubsan/stateful_results.html

UBsan Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/ubsan/stress_results.html

Debug

Debug Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_3.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_4.html

Fails

Test: 02888_system_tables_with_inaccsessible_table_function
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_1.html
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_2.html
Comment: Known fail.
Status: Known fail.

Test: 02920_alter_column_of_projections
Log: https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/debug/stateless_results_3.html
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Debug Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/debug/stateful_results.html

Debug Stress

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stress/debug/stress_results.html

Comment: Flaky. Status: OK to fail.

Aarch64

Aarch64 Stateful

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateful/aarch64/stateful_results.html

Aarch64 Stateless

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.8.16.42.altinitystable/2024-10-22T03-18-50.017/stateless/aarch64/stateless_results.html

Fails

Test: 02920_alter_column_of_projections
Comment: Sorting key contains nullable columns, but merge tree setting allow_nullable_key is disabled.
Status: OK to fail.

Test: 02888_system_tables_with_inaccsessible_table_function
Comment: Connections to mysql failed.
Status: OK to fail.

Test: 02907_backup_mv_with_no_inner_table
Comment: Disk ''backups'' is not allowed for backups.
Status: OK to fail.

Test: 01710_projection_fix_crash
Comment: Known fail.
Status: Known fail.

Aarch64 Regression

Results
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- ClickHouse Keeper
- Data Types
- DateTime64 Extended Range
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- Key Value
- Lightweight Delete
- Memory
- Part Moves Between Shards
- Selects
- Session Timezone
- SSL Server
- Tiered Storage
- Window Functions
- Alter Replace
- Alter Move
- Benchmark Minio
- Benchmark AWS
- Benchmark GCS
- ClickHouse Keeper SSL
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Parquet
- Parquet Minio
- Parquet AWS
- S3 AWS
- S3 GCS
- Tiered Storage AWS
- Tiered Storage GCS

Fails:

Test: RBAC
Comment: Flaky.
Status: OK to fail.

Test: Alter Attach
Comment: Flaky.
Status: OK to fail.

Test: S3 Minio
Comment: Flaky.
Status: OK to fail.

Test: Tiered Storage Minio
Comment: Flaky.
Status: OK to fail.