Alter Test Run Report

DateJul 22, 2024 9:27
Duration1h 50m
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archx86_64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_release/clickhouse-common-static_24.3.5.47.altinitystable_amd64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse
use_specific_versiondocker://altinity/clickhouse-server:23.3.13.7.altinitytest

Summary

99.7%OK
<1%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
18
18
Scenarios
860
857
3
Checks
1013
1013
Steps
223193
220346
2834
13

Known Fails

Test NameResultMessage
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partitionXFail 3s 803ms
The pr is not done yet: https://github.com/ClickHouse/ClickHouse/pull/54272
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 212, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/regression.py", line 206, in regression
    Feature(run=load("alter.table.replace_partition.feature", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/feature.py", line 59, in feature
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 141, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py", line 123, in mutations_on_unrelated_partition
    assert old_data.output.strip() != new_data.output.strip(), error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert old_data.output.strip() != new_data.output.strip(), error()

Assertion values
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
         ^ is = '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = 
  assert old_data.output.strip() != new_data.output.strip(), error()
                                    ^ is = '1031124695628436670\n1433092128651969876\n2907663814060020685\n8631521677239966240\n8680818300177168874\n10839865498072422600\n10896184591667769961\n12283887909763910453\n15901871587995430765\n18271399884308518585'
  assert old_data.output.strip() != new_data.output.strip(), error()
                                 ^ is = False
  assert old_data.output.strip() != new_data.output.strip(), error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/alter/../alter/table/replace_partition/concurrent_merges_and_mutations.py', line 123 in 'mutations_on_unrelated_partition'

115\|      with And("that the mutation is still running as the replace partition stopped it"):
116\|          with By(
117\|              "confirming that the the i column, which mutation should've changed still has the old data"
118\|          ):
119\|              new_data = node.query(
120\|                  f"SELECT i FROM {destination_table} WHERE p == 1 ORDER BY tuple(*) FORMAT TabSeparated"
121\|              )
122\|  
123\|>             assert old_data.output.strip() != new_data.output.strip(), error()
124\|  
125\|  
126\|  @TestFeature

Results

Test Name Result Duration
/alter OK 1h 50m
/alter/replace partition OK 1h 43m
/alter/replace partition/partition types OK 48s 549ms
/alter/replace partition/partition types/replace partition with different partition types OK 48s 547ms
/alter/replace partition/rbac OK 24m 33s
/alter/replace partition/rbac/check replace partition with privileges OK 24m 33s
/alter/replace partition/concurrent replace partitions OK 8m 21s
/alter/replace partition/data integrity OK 11s 926ms
/alter/replace partition/data integrity/keep data on a source table OK 2s 315ms
/alter/replace partition/data integrity/non existent partition destination OK 3s 309ms
/alter/replace partition/data integrity/non existent partition source OK 3s 382ms
/alter/replace partition/data integrity/partition changes in system OK 2s 916ms
/alter/replace partition/prohibited actions OK 19s 56ms
/alter/replace partition/prohibited actions/from clause OK 8s 711ms
/alter/replace partition/prohibited actions/from clause/table functions OK 1s 336ms
/alter/replace partition/prohibited actions/from clause/join OK 1s 324ms
/alter/replace partition/prohibited actions/from clause/subquery OK 1s 313ms
/alter/replace partition/prohibited actions/from clause/non mergetree table OK 1s 482ms
/alter/replace partition/prohibited actions/from clause/view OK 331ms
/alter/replace partition/prohibited actions/from clause/materialized view OK 303ms
/alter/replace partition/prohibited actions/from clause/remote OK 1s 289ms
/alter/replace partition/prohibited actions/from clause/remote secure OK 1s 326ms
/alter/replace partition/prohibited actions/conditions OK 5s 234ms
/alter/replace partition/prohibited actions/conditions/storage policy OK 1s 282ms
/alter/replace partition/prohibited actions/conditions/partition by OK 1s 378ms
/alter/replace partition/prohibited actions/conditions/order by OK 1s 239ms
/alter/replace partition/prohibited actions/conditions/structure OK 1s 331ms
/alter/replace partition/prohibited actions/miscellaneous OK 5s 108ms
/alter/replace partition/prohibited actions/miscellaneous/order by partition by OK 1s 279ms
/alter/replace partition/prohibited actions/miscellaneous/into outfile OK 1s 267ms
/alter/replace partition/prohibited actions/miscellaneous/format OK 1s 244ms
/alter/replace partition/prohibited actions/miscellaneous/settings OK 1s 314ms
/alter/replace partition/temporary table OK 2s 563ms
/alter/replace partition/temporary table/from temporary to regular OK 1s 288ms
/alter/replace partition/temporary table/from temporary to temporary table OK 634ms
/alter/replace partition/temporary table/from regular to temporary OK 637ms
/alter/replace partition/engines OK 1m 31s
/alter/replace partition/engines/replace partition with different engines OK 1m 31s
/alter/replace partition/concurrent actions OK 1h 40m
/alter/replace partition/concurrent actions/one replace partition OK 1h 25m
/alter/replace partition/concurrent replace partitions/concurrent replace OK 32s 817ms
/alter/replace partition/concurrent merges and mutations OK 10s 288ms
/alter/replace partition/concurrent merges and mutations/merges on unrelated partition OK 6s 482ms
/alter/replace partition/concurrent merges and mutations/mutations on unrelated partition XFail 3s 803ms
/alter/replace partition/storage OK 34s 693ms
/alter/replace partition/storage/different disks OK 1s 204ms
/alter/replace partition/storage/shards OK 1s 354ms
/alter/replace partition/storage/replicas OK 3s 693ms
/alter/replace partition/storage/replace partition on minio and default disks OK 10s 261ms
/alter/replace partition/storage/replace partition on tiered and default storages OK 9s 387ms
/alter/replace partition/storage/partition moved to another disk OK 8s 789ms
/alter/replace partition/corrupted partitions OK 2m 31s
/alter/replace partition/corrupted partitions/replace partition with corrupted parts OK 2m 31s
/alter/replace partition/clickhouse versions OK 1m 7s
/alter/replace partition/clickhouse versions/replace partition on table created after update OK 22s 303ms
/alter/replace partition/clickhouse versions/replace partition on table created before update OK 14s 137ms
/alter/replace partition/clickhouse versions/replace partition on updated and reverted version OK 15s 501ms
/alter/replace partition/clickhouse versions/replace partition on updated version OK 14s 886ms
/alter/replace partition/concurrent replace partitions on replicas OK 29m 47s
/alter/replace partition/concurrent replace partitions on replicas/multiple shards with replicas OK 9m 23s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas OK 9m 28s
/alter/replace partition/concurrent replace partitions on replicas/single shard three replicas secure OK 10m 56s
/alter/replace partition/partition keys OK 2m 41s
/alter/replace partition/partition keys/replace partition partition key OK 2m 41s
/alter/replace partition/concurrent actions/replace partition along other actions OK 15m 11s

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204