Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Clickhouse Keeper Test Run Report

DateMar 01, 2024 21:04
Duration1h 17m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archaarch64
sslFalse
stressFalse
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_aarch64/clickhouse-common-static_23.3.19.33.altinitystable_arm64.deb
collect_service_logsTrue

Summary

91.7%OK
8.3%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
12
10
2
Scenarios
68
62
6
Checks
13
13
Examples
2
2
Steps
13192
12961
231

Known Fails

Test NameResultMessage
/clickhouse keeper/migration/migrate from zookeeper to standalone keeperXFail 1ms
test doesn't work from 23.3
None
/clickhouse keeper/cli converter/output dir invalidXFail 3m 55s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 182, in output_dir_invalid
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 1 snapshots, will use latest
Deserializing storage snapshot /share/zookeeper3/data/version-2/snapshot.0
Magic deserialized, looks OK
Sessions and timeouts deserialized
ACLs deserialized
Deserializing data from snapshot
Finished, snapshot ZXID 0
Totally have 1 logs
Deserializing log /share/zookeeper3/datalog/version-2/log.100000001
Header looks OK
Deserialized txns log: 1000
Deserialized txns log: 2000
Finished /share/zookeeper3/datalog/version-2/log.100000001 deserialization, totally read 2074 records
Snapshot serialized to path:/share/notexists/snapshot_4294969370.bin.zstd

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 0
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 107
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/cli converter/snapshot invalid dirXFail 3m 46s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 61, in snapshot_invalid_dir
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 0 snapshots, will use latest
Code: 246. DB::Exception: No snapshots found on path /share/notexists. At least one snapshot must exist. (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0xbb94ae4 in /usr/bin/clickhouse
1. ? @ 0x81242f0 in /usr/bin/clickhouse
2. DB::deserializeKeeperStorageFromSnapshotsDir(DB::KeeperStorage&, String const&, std::shared_ptr) @ 0x1190c55c in /usr/bin/clickhouse
3. mainEntryClickHouseKeeperConverter(int, char**) @ 0xbd7047c in /usr/bin/clickhouse
4. main @ 0x7dc22c0 in /usr/bin/clickhouse
5. __libc_start_main @ 0x20e10 in /usr/lib/aarch64-linux-gnu/libc-2.31.so
 (version 23.3.19.33.altinitystable (altinity build))

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 246
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 233
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/keeper cluster tests/standalone keepers 3XFail 1ms
Not stable
None
/clickhouse keeper/keeper cluster tests/zookeepers 3XFail 1ms
unstable from 23.3
None
/clickhouse keeper/four letter word commands/wchc commandXFail 1ms
test doesn't work from 22.8
None
/clickhouse keeper/servers start upXFail 778us
unstable fix check
None
/clickhouse keeper/coordination settingsXFail 664us
test doesn't work from 23.3
None

Results

Test Name Result Duration
/clickhouse keeper OK 1h 17m
/clickhouse keeper/sanity OK 1s 122ms
/clickhouse keeper/sanity/select 1 OK 1s 121ms
/clickhouse keeper/migration OK 12m 4s
/clickhouse keeper/migration/migrate from zookeeper to mixed servers OK 12m 4s
/clickhouse keeper/migration/migrate from zookeeper to standalone keeper XFail 1ms
/clickhouse keeper/synchronization OK 3m 29s
/clickhouse keeper/synchronization/attach OK 352ms
/clickhouse keeper/synchronization/create OK 11s 461ms
/clickhouse keeper/synchronization/detach OK 1s 622ms
/clickhouse keeper/synchronization/drop OK 11s 568ms
/clickhouse keeper/synchronization/insert OK 10s 472ms
/clickhouse keeper/synchronization/rename OK 1s 952ms
/clickhouse keeper/synchronization/truncate OK 1s 394ms
/clickhouse keeper/cli OK 19s 712ms
/clickhouse keeper/cli/config OK 110ms
/clickhouse keeper/cli/daemon OK 19s 405ms
/clickhouse keeper/cli/unknown option OK 115ms
/clickhouse keeper/cli/version OK 78ms
/clickhouse keeper/cli converter OK 27m 4s
/clickhouse keeper/cli converter/help option OK 78ms
/clickhouse keeper/cli converter/logs OK 4m 15s
/clickhouse keeper/cli converter/logs invalid dir OK 3m 50s
/clickhouse keeper/cli converter/missing arg values OK 3m 49s
/clickhouse keeper/cli converter/output dir OK 3m 41s
/clickhouse keeper/cli converter/output dir invalid XFail 3m 55s
/clickhouse keeper/cli converter/snapshot OK 3m 44s
/clickhouse keeper/cli converter/snapshot invalid dir XFail 3m 46s
/clickhouse keeper/non distributed ddl queries OK 1m 10s
/clickhouse keeper/non distributed ddl queries/create OK 928ms
/clickhouse keeper/non distributed ddl queries/drop OK 883ms
/clickhouse keeper/non distributed ddl queries/rename OK 1s 132ms
/clickhouse keeper/non distributed ddl queries/truncate OK 1s 193ms
/clickhouse keeper/keeper cluster tests OK 21m 52s
/clickhouse keeper/keeper cluster tests/mixed keepers 1 OK 2m 38s
/clickhouse keeper/keeper cluster tests/mixed keepers 2 OK 3m 8s
/clickhouse keeper/keeper cluster tests/mixed keepers 3 OK 3m 29s
/clickhouse keeper/keeper cluster tests/mixed keepers 4 OK 2m 56s
/clickhouse keeper/keeper cluster tests/mixed keepers 5 OK 3m 18s
/clickhouse keeper/keeper cluster tests/standalone keepers 1 OK 3m 43s
/clickhouse keeper/keeper cluster tests/standalone keepers 2 OK 2m 37s
/clickhouse keeper/keeper cluster tests/standalone keepers 3 XFail 1ms
/clickhouse keeper/keeper cluster tests/zookeepers 3 XFail 1ms
/clickhouse keeper/alter column distributed OK 1m 23s
/clickhouse keeper/alter column distributed/alter add column OK 1s 790ms
/clickhouse keeper/alter column distributed/alter clear column OK 2s 222ms
/clickhouse keeper/alter column distributed/alter comment column OK 1s 968ms
/clickhouse keeper/alter column distributed/alter drop column OK 2s 230ms
/clickhouse keeper/alter column distributed/alter modify column OK 2s 150ms
/clickhouse keeper/alter column distributed/alter modify column remove OK 1s 182ms
/clickhouse keeper/alter column distributed/alter rename column OK 2s 110ms
/clickhouse keeper/alter_partition_distributed OK 2m 45s
/clickhouse keeper/alter_partition_distributed/alter attach partition OK 1s 762ms
/clickhouse keeper/alter_partition_distributed/alter attach partition from OK 2s 272ms
/clickhouse keeper/alter_partition_distributed/alter clear column in partition OK 1s 494ms
/clickhouse keeper/alter_partition_distributed/alter clear index in partition OK 1s 180ms
/clickhouse keeper/alter_partition_distributed/alter delete in partition OK 1s 371ms
/clickhouse keeper/alter_partition_distributed/alter detach partition OK 1s 651ms
/clickhouse keeper/alter_partition_distributed/alter drop partition OK 1s 671ms
/clickhouse keeper/alter_partition_distributed/alter fetch partition OK 1s 443ms
/clickhouse keeper/alter_partition_distributed/alter freeze partition OK 1s 202ms
/clickhouse keeper/alter_partition_distributed/alter move partition to table OK 2s 352ms
/clickhouse keeper/alter_partition_distributed/alter replace partition from OK 2s 398ms
/clickhouse keeper/alter_partition_distributed/alter unfreeze partition OK 1s 288ms
/clickhouse keeper/alter_partition_distributed/alter update in partition OK 1s 96ms
/clickhouse keeper/four letter word commands OK 1m 50s
/clickhouse keeper/four letter word commands/conf command OK 197ms
/clickhouse keeper/four letter word commands/cons command OK 189ms
/clickhouse keeper/four letter word commands/crst command OK 189ms
/clickhouse keeper/four letter word commands/dirs command OK 207ms
/clickhouse keeper/four letter word commands/envi command OK 192ms
/clickhouse keeper/four letter word commands/isro command OK 194ms
/clickhouse keeper/four letter word commands/mntr command OK 188ms
/clickhouse keeper/four letter word commands/ruok command OK 202ms
/clickhouse keeper/four letter word commands/srst command OK 203ms
/clickhouse keeper/four letter word commands/srvr command OK 189ms
/clickhouse keeper/four letter word commands/stat command OK 238ms
/clickhouse keeper/four letter word commands/wchc command XFail 1ms
/clickhouse keeper/four letter word commands/wchs command OK 186ms
/clickhouse keeper/servers start up XFail 778us
/clickhouse keeper/coordination settings XFail 664us

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232