Dns Test Run Report

DateDec 26, 2023 12:54
Duration1m 25s
Framework TestFlows 2.0.231130.1212236

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
version23.8.8.21.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash09db6160aac30e37169797b73fac77b4cbca41c6
job.id7328846900
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/7328846900
archx86_64
clickhouse_versionNone
stressFalse
localTrue
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
collect_service_logsTrue

Summary

85.7%OK
14.3%Known

Statistics

Units OK Fail XFail
Modules
1
1
Suites
1
1
Features
1
1
Scenarios
4
3
1
Steps
107
105
2

Known Fails

Test NameResultMessage
/dns/lookupXFail 139ms
https://github.com/ClickHouse/ClickHouse/issues/17202
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 58, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 53, in regression
    Scenario(run=load("dns.tests.lookup.scenario", "scenario"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../dns/tests/lookup/scenario.py", line 48, in scenario
    cluster.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py", line 1444, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Bash: regression/dns/tests/lookup/example.com: No such file or directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py', line 1444 in 'command'

1436\|          if exitcode is not None:
1437\|              with Then(
1438\|                  f"exitcode should be {exitcode}", format_name=False
1439\|              ) if steps else NullStep():
1440\|                  if str(exitcode).startswith("!="):
1441\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1442\|                      assert r.exitcode != exitcode, error(r.output)
1443\|                  else:
1444\|>                     assert r.exitcode == exitcode, error(r.output)
1445\|  
1446\|          if messages is None:
1447\|              messages = []

Results

Test Name Result Duration
/dns OK 1m 25s
/dns/lookup XFail 139ms
/dns/ipv6 OK 245ms
/dns/ipv6/Test host regexp multiple ptr v4 fails with wrong resolution OK 84ms
/dns/ipv6/Test host regexp multiple ptr v4 OK 76ms
/dns/ipv6/Test host regexp multiple ptr v6 OK 77ms

Generated by TestFlows Open-Source Test Framework v2.0.231130.1212236