Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Clickhouse Keeper Test Run Report

DateMar 01, 2024 21:09
Duration1h 8m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archx86_64
sslFalse
stressFalse
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
collect_service_logsTrue

Summary

91.7%OK
8.3%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
12
10
2
Scenarios
68
62
6
Checks
13
13
Examples
2
2
Steps
13259
12997
262

Known Fails

Test NameResultMessage
/clickhouse keeper/migration/migrate from zookeeper to standalone keeperXFail 1ms
test doesn't work from 23.3
None
/clickhouse keeper/cli converter/output dir invalidXFail 3m 19s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 182, in output_dir_invalid
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 1 snapshots, will use latest
Deserializing storage snapshot /share/zookeeper3/data/version-2/snapshot.0
Magic deserialized, looks OK
Sessions and timeouts deserialized
ACLs deserialized
Deserializing data from snapshot
Finished, snapshot ZXID 0
Totally have 1 logs
Deserializing log /share/zookeeper3/datalog/version-2/log.100000001
Header looks OK
Deserialized txns log: 1000
Deserialized txns log: 2000
Finished /share/zookeeper3/datalog/version-2/log.100000001 deserialization, totally read 2062 records
Snapshot serialized to path:/share/notexists/snapshot_4294969358.bin.zstd

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 0
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 107
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/cli converter/snapshot invalid dirXFail 3m 10s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 61, in snapshot_invalid_dir
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 0 snapshots, will use latest
Code: 246. DB::Exception: No snapshots found on path /share/notexists. At least one snapshot must exist. (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0xe295a55 in /usr/bin/clickhouse
1. ? @ 0x8e21744 in /usr/bin/clickhouse
2. DB::deserializeKeeperStorageFromSnapshotsDir(DB::KeeperStorage&, String const&, std::shared_ptr) @ 0x151393e1 in /usr/bin/clickhouse
3. mainEntryClickHouseKeeperConverter(int, char**) @ 0xe4bdef3 in /usr/bin/clickhouse
4. main @ 0x8a9db33 in /usr/bin/clickhouse
5. __libc_start_main @ 0x7f48a6319083 in ?
6. _start @ 0x8090bee in /usr/bin/clickhouse
 (version 23.3.19.33.altinitystable (altinity build))

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 246
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 233
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/keeper cluster tests/standalone keepers 3XFail 611us
Not stable
None
/clickhouse keeper/keeper cluster tests/zookeepers 3XFail 496us
unstable from 23.3
None
/clickhouse keeper/four letter word commands/wchc commandXFail 601us
test doesn't work from 22.8
None
/clickhouse keeper/servers start upXFail 609us
unstable fix check
None
/clickhouse keeper/coordination settingsXFail 3ms
test doesn't work from 23.3
None

Results

Test Name Result Duration
/clickhouse keeper OK 1h 8m
/clickhouse keeper/sanity OK 712ms
/clickhouse keeper/sanity/select 1 OK 711ms
/clickhouse keeper/migration OK 10m 20s
/clickhouse keeper/migration/migrate from zookeeper to mixed servers OK 10m 20s
/clickhouse keeper/migration/migrate from zookeeper to standalone keeper XFail 1ms
/clickhouse keeper/synchronization OK 2m 35s
/clickhouse keeper/synchronization/attach OK 205ms
/clickhouse keeper/synchronization/create OK 9s 807ms
/clickhouse keeper/synchronization/detach OK 1s 32ms
/clickhouse keeper/synchronization/drop OK 9s 826ms
/clickhouse keeper/synchronization/insert OK 10s 25ms
/clickhouse keeper/synchronization/rename OK 1s 338ms
/clickhouse keeper/synchronization/truncate OK 904ms
/clickhouse keeper/cli OK 13s 456ms
/clickhouse keeper/cli/config OK 42ms
/clickhouse keeper/cli/daemon OK 13s 337ms
/clickhouse keeper/cli/unknown option OK 38ms
/clickhouse keeper/cli/version OK 36ms
/clickhouse keeper/cli converter OK 23m 34s
/clickhouse keeper/cli converter/help option OK 33ms
/clickhouse keeper/cli converter/logs OK 3m 51s
/clickhouse keeper/cli converter/logs invalid dir OK 3m 21s
/clickhouse keeper/cli converter/missing arg values OK 3m 16s
/clickhouse keeper/cli converter/output dir OK 3m 22s
/clickhouse keeper/cli converter/output dir invalid XFail 3m 19s
/clickhouse keeper/cli converter/snapshot OK 3m 12s
/clickhouse keeper/cli converter/snapshot invalid dir XFail 3m 10s
/clickhouse keeper/non distributed ddl queries OK 55s 740ms
/clickhouse keeper/non distributed ddl queries/create OK 596ms
/clickhouse keeper/non distributed ddl queries/drop OK 616ms
/clickhouse keeper/non distributed ddl queries/rename OK 799ms
/clickhouse keeper/non distributed ddl queries/truncate OK 883ms
/clickhouse keeper/keeper cluster tests OK 22m 29s
/clickhouse keeper/keeper cluster tests/mixed keepers 1 OK 2m 21s
/clickhouse keeper/keeper cluster tests/mixed keepers 2 OK 2m 42s
/clickhouse keeper/keeper cluster tests/mixed keepers 3 OK 2m 55s
/clickhouse keeper/keeper cluster tests/mixed keepers 4 OK 3m 32s
/clickhouse keeper/keeper cluster tests/mixed keepers 5 OK 5m 30s
/clickhouse keeper/keeper cluster tests/standalone keepers 1 OK 2m 59s
/clickhouse keeper/keeper cluster tests/standalone keepers 2 OK 2m 27s
/clickhouse keeper/keeper cluster tests/standalone keepers 3 XFail 611us
/clickhouse keeper/keeper cluster tests/zookeepers 3 XFail 496us
/clickhouse keeper/alter column distributed OK 1m 9s
/clickhouse keeper/alter column distributed/alter add column OK 1s 155ms
/clickhouse keeper/alter column distributed/alter clear column OK 1s 522ms
/clickhouse keeper/alter column distributed/alter comment column OK 1s 331ms
/clickhouse keeper/alter column distributed/alter drop column OK 1s 323ms
/clickhouse keeper/alter column distributed/alter modify column OK 1s 400ms
/clickhouse keeper/alter column distributed/alter modify column remove OK 784ms
/clickhouse keeper/alter column distributed/alter rename column OK 1s 428ms
/clickhouse keeper/alter_partition_distributed OK 1m 53s
/clickhouse keeper/alter_partition_distributed/alter attach partition OK 1s 235ms
/clickhouse keeper/alter_partition_distributed/alter attach partition from OK 1s 657ms
/clickhouse keeper/alter_partition_distributed/alter clear column in partition OK 1s 61ms
/clickhouse keeper/alter_partition_distributed/alter clear index in partition OK 834ms
/clickhouse keeper/alter_partition_distributed/alter delete in partition OK 983ms
/clickhouse keeper/alter_partition_distributed/alter detach partition OK 1s 23ms
/clickhouse keeper/alter_partition_distributed/alter drop partition OK 1s 107ms
/clickhouse keeper/alter_partition_distributed/alter fetch partition OK 897ms
/clickhouse keeper/alter_partition_distributed/alter freeze partition OK 855ms
/clickhouse keeper/alter_partition_distributed/alter move partition to table OK 1s 722ms
/clickhouse keeper/alter_partition_distributed/alter replace partition from OK 1s 634ms
/clickhouse keeper/alter_partition_distributed/alter unfreeze partition OK 911ms
/clickhouse keeper/alter_partition_distributed/alter update in partition OK 805ms
/clickhouse keeper/four letter word commands OK 1m 32s
/clickhouse keeper/four letter word commands/conf command OK 132ms
/clickhouse keeper/four letter word commands/cons command OK 132ms
/clickhouse keeper/four letter word commands/crst command OK 130ms
/clickhouse keeper/four letter word commands/dirs command OK 136ms
/clickhouse keeper/four letter word commands/envi command OK 125ms
/clickhouse keeper/four letter word commands/isro command OK 190ms
/clickhouse keeper/four letter word commands/mntr command OK 144ms
/clickhouse keeper/four letter word commands/ruok command OK 134ms
/clickhouse keeper/four letter word commands/srst command OK 135ms
/clickhouse keeper/four letter word commands/srvr command OK 134ms
/clickhouse keeper/four letter word commands/stat command OK 133ms
/clickhouse keeper/four letter word commands/wchc command XFail 601us
/clickhouse keeper/four letter word commands/wchs command OK 128ms
/clickhouse keeper/servers start up XFail 609us
/clickhouse keeper/coordination settings XFail 3ms

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232