Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Dns Test Run Report

DateNov 05, 2024 18:10
Duration1m 59s
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/5b67ba5a4febfa774d6373929d551c6a697d7d92/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
version24.3.12.76.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id11672696143
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/11672696143
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/5b67ba5a4febfa774d6373929d551c6a697d7d92/package_aarch64/clickhouse-common-static_24.3.12.76.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse

Summary

83.3%OK
16.7%Known

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
4
3
1
Steps
116
107
2
4
3

Known Fails

Test NameResultMessage
/dns/lookupXFail 222ms
https://github.com/ClickHouse/ClickHouse/issues/17202
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 60, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 55, in regression
    Scenario(run=load("dns.tests.lookup.scenario", "scenario"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../dns/tests/lookup/scenario.py", line 48, in scenario
    cluster.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py", line 1960, in command
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Bash: regression/dns/tests/lookup/example.com: No such file or directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py', line 1960 in 'command'

1952\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1953\|                  if steps
1954\|                  else NullStep()
1955\|              ):
1956\|                  if str(exitcode).startswith("!="):
1957\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1958\|                      assert r.exitcode != exitcode, error(r.output)
1959\|                  else:
1960\|>                     assert r.exitcode == exitcode, error(r.output)
1961\|  
1962\|          if messages is None:
1963\|              messages = []

Results

Test Name Result Duration
/dns OK 1m 59s
/dns/lookup XFail 222ms
/dns/ipv6 OK 400ms
/dns/ipv6/Test host regexp multiple ptr v4 fails with wrong resolution OK 155ms
/dns/ipv6/Test host regexp multiple ptr v4 OK 119ms
/dns/ipv6/Test host regexp multiple ptr v6 OK 106ms

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204