Alter Test Run Report

DateNov 05, 2024 18:09
Duration2h 35m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
use_specific_versiondocker://altinity/clickhouse-server:23.3.13.7.altinitytest

Summary

99.7%OK
<1%Known

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
18
18
Scenarios
860
857
3
Checks
1013
1013
Steps
222533
220809
1703
8
13

Known Fails

Test NameResultMessage
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partitionXFail 4s 280ms
The pr is not done yet: https://github.com/ClickHouse/ClickHouse/pull/54272
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 212, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 206, in regression
    Feature(run=load("alter.table.replace_partition.feature", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/feature.py", line 59, in feature
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 141, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 123, in mutations_on_unrelated_partition
    assert old_data.output.strip() != new_data.output.strip(), error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert old_data.output.strip() != new_data.output.strip(), error()

Assertion values
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '817971090195219437\n1253457222771642282\n2142040516511847088\n2295813215976273646\n3016389187096124758\n3538019278889924282\n6158850419396284032\n7863319179793901992\n12088641411623089569\n16832893234780419264'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                 ^ is = False
  assert old_data.output.strip() != new_data.output.strip(), error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py', line 123 in 'mutations_on_unrelated_partition'

115\|      with And("that the mutation is still running as the replace partition stopped it"):
116\|          with By(
117\|              "confirming that the the i column, which mutation should've changed still has the old data"
118\|          ):
119\|              new_data = node.query(
120\|                  f"SELECT i FROM {destination_table} WHERE p == 1 ORDER BY tuple(*) FORMAT TabSeparated"
121\|              )
122\|  
123\|>             assert old_data.output.strip() != new_data.output.strip(), error()
124\|  
125\|  
126\|  @TestFeature

Results

Test Name Result Duration
/alter OK 2h 35m
/alter/replace partition OK 2h 31m
/alter/replace partition/partition types OK 41s 653ms
/alter/replace partition/partition types/replace partition with different partition types OK 41s 651ms
/alter/replace partition/rbac OK 39m 50s
/alter/replace partition/rbac/check replace partition with privileges OK 39m 50s
/alter/replace partition/concurrent replace partitions OK 11m 44s
/alter/replace partition/data integrity OK 9s 101ms
/alter/replace partition/data integrity/keep data on a source table OK 2s 33ms
/alter/replace partition/data integrity/non existent partition destination OK 2s 604ms
/alter/replace partition/data integrity/non existent partition source OK 2s 208ms
/alter/replace partition/data integrity/partition changes in system OK 2s 252ms
/alter/replace partition/prohibited actions OK 15s 390ms
/alter/replace partition/prohibited actions/from clause OK 6s 939ms
/alter/replace partition/prohibited actions/from clause/table functions OK 1s 38ms
/alter/replace partition/prohibited actions/from clause/join OK 1s 81ms
/alter/replace partition/prohibited actions/from clause/subquery OK 1s 69ms
/alter/replace partition/prohibited actions/from clause/non mergetree table OK 1s 171ms
/alter/replace partition/prohibited actions/from clause/view OK 231ms
/alter/replace partition/prohibited actions/from clause/materialized view OK 249ms
/alter/replace partition/prohibited actions/from clause/remote OK 1s 33ms
/alter/replace partition/prohibited actions/from clause/remote secure OK 1s 61ms
/alter/replace partition/prohibited actions/conditions OK 4s 286ms
/alter/replace partition/prohibited actions/conditions/storage policy OK 1s 52ms
/alter/replace partition/prohibited actions/conditions/partition by OK 1s 101ms
/alter/replace partition/prohibited actions/conditions/order by OK 1s 68ms
/alter/replace partition/prohibited actions/conditions/structure OK 1s 61ms
/alter/replace partition/prohibited actions/miscellaneous OK 4s 162ms
/alter/replace partition/prohibited actions/miscellaneous/order by partition by OK 1s 57ms
/alter/replace partition/prohibited actions/miscellaneous/into outfile OK 1s 13ms
/alter/replace partition/prohibited actions/miscellaneous/format OK 1s 71ms
/alter/replace partition/prohibited actions/miscellaneous/settings OK 1s 19ms
/alter/replace partition/temporary table OK 5s 930ms
/alter/replace partition/temporary table/from temporary to regular OK 2s 442ms
/alter/replace partition/temporary table/from temporary to temporary table OK 1s 737ms
/alter/replace partition/temporary table/from regular to temporary OK 1s 749ms
/alter/replace partition/engines OK 1m 14s
/alter/replace partition/engines/replace partition with different engines OK 1m 14s
/alter/replace partition/concurrent actions OK 2h 28m
/alter/replace partition/concurrent actions/one replace partition OK 2h 13m
/alter/replace partition/concurrent replace partitions/concurrent replace OK 49s 882ms
/alter/replace partition/concurrent merges and mutations OK 10s 299ms
/alter/replace partition/concurrent merges and mutations/merges on unrelated partition OK 6s 16ms
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partition XFail 4s 280ms
/alter/replace partition/storage OK 2m 56s
/alter/replace partition/storage/different disks OK 1s 41ms
/alter/replace partition/storage/shards OK 22s 335ms
/alter/replace partition/storage/replicas OK 28s 311ms
/alter/replace partition/storage/replace partition on minio and default disks OK 1m 41s
/alter/replace partition/storage/replace partition on tiered and default storages OK 13s 861ms
/alter/replace partition/storage/partition moved to another disk OK 9s 339ms
/alter/replace partition/corrupted partitions OK 4m 9s
/alter/replace partition/corrupted partitions/replace partition with corrupted parts OK 4m 9s
/alter/replace partition/clickhouse versions OK 1m 19s
/alter/replace partition/clickhouse versions/replace partition on table created after update OK 8s 803ms
/alter/replace partition/clickhouse versions/replace partition on table created before update OK 9s 403ms
/alter/replace partition/clickhouse versions/replace partition on updated and reverted version OK 14s 459ms
/alter/replace partition/clickhouse versions/replace partition on updated version OK 46s 201ms
/alter/replace partition/concurrent replace partitions on replicas OK 56m 35s
/alter/replace partition/concurrent replace partitions on replicas/multiple shards with replicas OK 19m 25s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas OK 17m 9s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas secure OK 19m 59s
/alter/replace partition/partition keys OK 5m 52s
/alter/replace partition/partition keys/replace partition partition key OK 5m 52s
/alter/replace partition/concurrent actions/replace partition along other actions OK 15m 15s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204