Alter Test Run Report

DateNov 04, 2024 21:58
Duration1h 5m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_release/clickhouse-common-static_24.3.12.76.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
use_specific_versiondocker://altinity/clickhouse-server:23.3.13.7.altinitytest

Summary

99.7%OK
<1%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
18
18
Scenarios
860
857
3
Checks
1013
1013
Steps
226668
223017
3638
13

Known Fails

Test NameResultMessage
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partitionXFail 2s 51ms
The pr is not done yet: https://github.com/ClickHouse/ClickHouse/pull/54272
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 212, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 206, in regression
    Feature(run=load("alter.table.replace_partition.feature", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/feature.py", line 59, in feature
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 141, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 123, in mutations_on_unrelated_partition
    assert old_data.output.strip() != new_data.output.strip(), error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert old_data.output.strip() != new_data.output.strip(), error()

Assertion values
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '4349081520650620783\n6805506710101709703\n7576117626331342926\n8728751435135912109\n8971133618285528620\n10238292801615033581\n11120425241614681346\n12934820387418790688\n16173255612794838658\n17118279165043679884'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                 ^ is = False
  assert old_data.output.strip() != new_data.output.strip(), error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py', line 123 in 'mutations_on_unrelated_partition'

115\|      with And("that the mutation is still running as the replace partition stopped it"):
116\|          with By(
117\|              "confirming that the the i column, which mutation should've changed still has the old data"
118\|          ):
119\|              new_data = node.query(
120\|                  f"SELECT i FROM {destination_table} WHERE p == 1 ORDER BY tuple(*) FORMAT TabSeparated"
121\|              )
122\|  
123\|>             assert old_data.output.strip() != new_data.output.strip(), error()
124\|  
125\|  
126\|  @TestFeature

Results

Test Name Result Duration
/alter OK 1h 5m
/alter/replace partition OK 1h 2m
/alter/replace partition/partition types OK 28s 691ms
/alter/replace partition/partition types/replace partition with different partition types OK 28s 691ms
/alter/replace partition/rbac OK 14m 45s
/alter/replace partition/rbac/check replace partition with privileges OK 14m 45s
/alter/replace partition/concurrent replace partitions OK 5m 24s
/alter/replace partition/data integrity OK 7s 622ms
/alter/replace partition/data integrity/keep data on a source table OK 1s 987ms
/alter/replace partition/data integrity/non existent partition destination OK 1s 664ms
/alter/replace partition/data integrity/non existent partition source OK 1s 269ms
/alter/replace partition/data integrity/partition changes in system OK 2s 700ms
/alter/replace partition/prohibited actions OK 11s 101ms
/alter/replace partition/prohibited actions/from clause OK 4s 958ms
/alter/replace partition/prohibited actions/from clause/table functions OK 733ms
/alter/replace partition/prohibited actions/from clause/join OK 752ms
/alter/replace partition/prohibited actions/from clause/subquery OK 789ms
/alter/replace partition/prohibited actions/from clause/non mergetree table OK 844ms
/alter/replace partition/prohibited actions/from clause/view OK 188ms
/alter/replace partition/prohibited actions/from clause/materialized view OK 171ms
/alter/replace partition/prohibited actions/from clause/remote OK 734ms
/alter/replace partition/prohibited actions/from clause/remote secure OK 742ms
/alter/replace partition/prohibited actions/conditions OK 3s 68ms
/alter/replace partition/prohibited actions/conditions/storage policy OK 740ms
/alter/replace partition/prohibited actions/conditions/partition by OK 776ms
/alter/replace partition/prohibited actions/conditions/order by OK 755ms
/alter/replace partition/prohibited actions/conditions/structure OK 794ms
/alter/replace partition/prohibited actions/miscellaneous OK 3s 74ms
/alter/replace partition/prohibited actions/miscellaneous/order by partition by OK 786ms
/alter/replace partition/prohibited actions/miscellaneous/into outfile OK 743ms
/alter/replace partition/prohibited actions/miscellaneous/format OK 769ms
/alter/replace partition/prohibited actions/miscellaneous/settings OK 774ms
/alter/replace partition/temporary table OK 1s 752ms
/alter/replace partition/temporary table/from temporary to regular OK 813ms
/alter/replace partition/temporary table/from temporary to temporary table OK 493ms
/alter/replace partition/temporary table/from regular to temporary OK 442ms
/alter/replace partition/engines OK 56s 205ms
/alter/replace partition/engines/replace partition with different engines OK 56s 204ms
/alter/replace partition/concurrent actions OK 1h 0m
/alter/replace partition/concurrent actions/one replace partition OK 51m 54s
/alter/replace partition/concurrent replace partitions/concurrent replace OK 23s 440ms
/alter/replace partition/concurrent merges and mutations OK 7s 737ms
/alter/replace partition/concurrent merges and mutations/merges on unrelated partition OK 5s 643ms
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partition XFail 2s 51ms
/alter/replace partition/storage OK 42s 476ms
/alter/replace partition/storage/different disks OK 741ms
/alter/replace partition/storage/shards OK 871ms
/alter/replace partition/storage/replicas OK 4s 501ms
/alter/replace partition/storage/replace partition on minio and default disks OK 18s 640ms
/alter/replace partition/storage/replace partition on tiered and default storages OK 10s 296ms
/alter/replace partition/storage/partition moved to another disk OK 7s 422ms
/alter/replace partition/corrupted partitions OK 1m 50s
/alter/replace partition/corrupted partitions/replace partition with corrupted parts OK 1m 50s
/alter/replace partition/clickhouse versions OK 52s 955ms
/alter/replace partition/clickhouse versions/replace partition on table created after update OK 7s 637ms
/alter/replace partition/clickhouse versions/replace partition on table created before update OK 9s 498ms
/alter/replace partition/clickhouse versions/replace partition on updated and reverted version OK 22s 99ms
/alter/replace partition/clickhouse versions/replace partition on updated version OK 13s 166ms
/alter/replace partition/concurrent replace partitions on replicas OK 18m 32s
/alter/replace partition/concurrent replace partitions on replicas/multiple shards with replicas OK 5m 36s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas OK 6m 41s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas secure OK 6m 14s
/alter/replace partition/partition keys OK 2m 27s
/alter/replace partition/partition keys/replace partition partition key OK 2m 27s
/alter/replace partition/concurrent actions/replace partition along other actions OK 8m 28s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204