Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Clickhouse Keeper Test Run Report

DateMar 19, 2024 17:40
Duration1h 11m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
version23.3.19.34.altinityfips
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8247806903
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8247806903
archx86_64
sslFalse
stressFalse
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/0a8ac3b092733da37e3e2a0079c486938a36790d/package_release/clickhouse-common-static_23.3.19.34.altinityfips_amd64.deb
collect_service_logsTrue

Summary

91.7%OK
8.3%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
12
10
2
Scenarios
68
62
6
Checks
13
13
Examples
2
2
Steps
13301
13018
283

Known Fails

Test NameResultMessage
/clickhouse keeper/migration/migrate from zookeeper to standalone keeperXFail 833us
test doesn't work from 23.3
None
/clickhouse keeper/cli converter/output dir invalidXFail 3m 18s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 182, in output_dir_invalid
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 2 snapshots, will use latest
Deserializing storage snapshot /share/zookeeper3/data/version-2/snapshot.100000000
Magic deserialized, looks OK
Sessions and timeouts deserialized
ACLs deserialized
Deserializing data from snapshot
Finished, snapshot ZXID 4294967296
Totally have 1 logs
Deserializing log /share/zookeeper3/datalog/version-2/log.100000001
Header looks OK
Deserialized txns log: 1000
Deserialized txns log: 2000
Finished /share/zookeeper3/datalog/version-2/log.100000001 deserialization, totally read 2069 records
Snapshot serialized to path:/share/notexists/snapshot_4294969365.bin.zstd

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 0
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 107
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/cli converter/snapshot invalid dirXFail 3m 24s
Improper behaviour <23.8
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 278, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/regression.py", line 261, in regression
    Feature(run=load("clickhouse_keeper.tests.cli_converter", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 249, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../clickhouse_keeper/tests/cli_converter.py", line 61, in snapshot_invalid_dir
    self.context.cluster.node("clickhouse1").command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 129, in command
    return self.cluster.command(self.name, *args, **kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Totally have 0 snapshots, will use latest
Code: 246. DB::Exception: No snapshots found on path /share/notexists. At least one snapshot must exist. (CORRUPTED_DATA), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0xe383855 in /usr/bin/clickhouse
1. ? @ 0x8f19604 in /usr/bin/clickhouse
2. DB::deserializeKeeperStorageFromSnapshotsDir(DB::KeeperStorage&, String const&, std::shared_ptr) @ 0x15226201 in /usr/bin/clickhouse
3. mainEntryClickHouseKeeperConverter(int, char**) @ 0xe5ac093 in /usr/bin/clickhouse
4. main @ 0x8b95ab3 in /usr/bin/clickhouse
5. __libc_start_main @ 0x7fdedea0b083 in ?
6. _start @ 0x802402e in /usr/bin/clickhouse
 (version 23.3.19.34.altinityfips (altinity build))

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 246
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 233
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/clickhouse_keeper/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []
/clickhouse keeper/keeper cluster tests/standalone keepers 3XFail 909us
Not stable
None
/clickhouse keeper/keeper cluster tests/zookeepers 3XFail 840us
unstable from 23.3
None
/clickhouse keeper/four letter word commands/wchc commandXFail 761us
test doesn't work from 22.8
None
/clickhouse keeper/servers start upXFail 1ms
unstable fix check
None
/clickhouse keeper/coordination settingsXFail 879us
test doesn't work from 23.3
None

Results

Test Name Result Duration
/clickhouse keeper OK 1h 11m
/clickhouse keeper/sanity OK 970ms
/clickhouse keeper/sanity/select 1 OK 968ms
/clickhouse keeper/migration OK 9m 48s
/clickhouse keeper/migration/migrate from zookeeper to mixed servers OK 9m 48s
/clickhouse keeper/migration/migrate from zookeeper to standalone keeper XFail 833us
/clickhouse keeper/synchronization OK 2m 43s
/clickhouse keeper/synchronization/attach OK 319ms
/clickhouse keeper/synchronization/create OK 10s 93ms
/clickhouse keeper/synchronization/detach OK 1s 278ms
/clickhouse keeper/synchronization/drop OK 10s 98ms
/clickhouse keeper/synchronization/insert OK 10s 167ms
/clickhouse keeper/synchronization/rename OK 1s 430ms
/clickhouse keeper/synchronization/truncate OK 1s 98ms
/clickhouse keeper/cli OK 13s 25ms
/clickhouse keeper/cli/config OK 64ms
/clickhouse keeper/cli/daemon OK 12s 847ms
/clickhouse keeper/cli/unknown option OK 52ms
/clickhouse keeper/cli/version OK 57ms
/clickhouse keeper/cli converter OK 23m 43s
/clickhouse keeper/cli converter/help option OK 61ms
/clickhouse keeper/cli converter/logs OK 3m 37s
/clickhouse keeper/cli converter/logs invalid dir OK 3m 19s
/clickhouse keeper/cli converter/missing arg values OK 3m 22s
/clickhouse keeper/cli converter/output dir OK 3m 18s
/clickhouse keeper/cli converter/output dir invalid XFail 3m 18s
/clickhouse keeper/cli converter/snapshot OK 3m 21s
/clickhouse keeper/cli converter/snapshot invalid dir XFail 3m 24s
/clickhouse keeper/non distributed ddl queries OK 59s 392ms
/clickhouse keeper/non distributed ddl queries/create OK 698ms
/clickhouse keeper/non distributed ddl queries/drop OK 682ms
/clickhouse keeper/non distributed ddl queries/rename OK 839ms
/clickhouse keeper/non distributed ddl queries/truncate OK 907ms
/clickhouse keeper/keeper cluster tests OK 23m 53s
/clickhouse keeper/keeper cluster tests/mixed keepers 1 OK 2m 44s
/clickhouse keeper/keeper cluster tests/mixed keepers 2 OK 3m 4s
/clickhouse keeper/keeper cluster tests/mixed keepers 3 OK 2m 33s
/clickhouse keeper/keeper cluster tests/mixed keepers 4 OK 4m 6s
/clickhouse keeper/keeper cluster tests/mixed keepers 5 OK 4m 28s
/clickhouse keeper/keeper cluster tests/standalone keepers 1 OK 4m 29s
/clickhouse keeper/keeper cluster tests/standalone keepers 2 OK 2m 26s
/clickhouse keeper/keeper cluster tests/standalone keepers 3 XFail 909us
/clickhouse keeper/keeper cluster tests/zookeepers 3 XFail 840us
/clickhouse keeper/alter column distributed OK 1m 6s
/clickhouse keeper/alter column distributed/alter add column OK 1s 365ms
/clickhouse keeper/alter column distributed/alter clear column OK 1s 791ms
/clickhouse keeper/alter column distributed/alter comment column OK 1s 466ms
/clickhouse keeper/alter column distributed/alter drop column OK 1s 393ms
/clickhouse keeper/alter column distributed/alter modify column OK 1s 537ms
/clickhouse keeper/alter column distributed/alter modify column remove OK 845ms
/clickhouse keeper/alter column distributed/alter rename column OK 1s 570ms
/clickhouse keeper/alter_partition_distributed OK 2m 24s
/clickhouse keeper/alter_partition_distributed/alter attach partition OK 1s 213ms
/clickhouse keeper/alter_partition_distributed/alter attach partition from OK 1s 644ms
/clickhouse keeper/alter_partition_distributed/alter clear column in partition OK 1s 34ms
/clickhouse keeper/alter_partition_distributed/alter clear index in partition OK 740ms
/clickhouse keeper/alter_partition_distributed/alter delete in partition OK 897ms
/clickhouse keeper/alter_partition_distributed/alter detach partition OK 1s 201ms
/clickhouse keeper/alter_partition_distributed/alter drop partition OK 1s 167ms
/clickhouse keeper/alter_partition_distributed/alter fetch partition OK 1s 116ms
/clickhouse keeper/alter_partition_distributed/alter freeze partition OK 975ms
/clickhouse keeper/alter_partition_distributed/alter move partition to table OK 1s 911ms
/clickhouse keeper/alter_partition_distributed/alter replace partition from OK 1s 937ms
/clickhouse keeper/alter_partition_distributed/alter unfreeze partition OK 915ms
/clickhouse keeper/alter_partition_distributed/alter update in partition OK 901ms
/clickhouse keeper/four letter word commands OK 2m 18s
/clickhouse keeper/four letter word commands/conf command OK 131ms
/clickhouse keeper/four letter word commands/cons command OK 117ms
/clickhouse keeper/four letter word commands/crst command OK 122ms
/clickhouse keeper/four letter word commands/dirs command OK 144ms
/clickhouse keeper/four letter word commands/envi command OK 117ms
/clickhouse keeper/four letter word commands/isro command OK 132ms
/clickhouse keeper/four letter word commands/mntr command OK 119ms
/clickhouse keeper/four letter word commands/ruok command OK 119ms
/clickhouse keeper/four letter word commands/srst command OK 139ms
/clickhouse keeper/four letter word commands/srvr command OK 159ms
/clickhouse keeper/four letter word commands/stat command OK 158ms
/clickhouse keeper/four letter word commands/wchc command XFail 761us
/clickhouse keeper/four letter word commands/wchs command OK 169ms
/clickhouse keeper/servers start up XFail 1ms
/clickhouse keeper/coordination settings XFail 879us

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232