Dns Test Run Report

DateMar 01, 2024 21:11
Duration1m 23s
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archx86_64
clickhouse_versionNone
stressFalse
allow_vfsFalse
localTrue
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
collect_service_logsTrue

Summary

83.3%OK
16.7%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
1
1
Scenarios
4
3
1
Steps
107
105
2

Known Fails

Test NameResultMessage
/dns/lookupXFail 135ms
https://github.com/ClickHouse/ClickHouse/issues/17202
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 59, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 54, in regression
    Scenario(run=load("dns.tests.lookup.scenario", "scenario"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../dns/tests/lookup/scenario.py", line 48, in scenario
    cluster.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py", line 1509, in command
    assert r.exitcode == exitcode, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Bash: regression/dns/tests/lookup/example.com: No such file or directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py', line 1509 in 'command'

1501\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1502\|                  if steps
1503\|                  else NullStep()
1504\|              ):
1505\|                  if str(exitcode).startswith("!="):
1506\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1507\|                      assert r.exitcode != exitcode, error(r.output)
1508\|                  else:
1509\|>                     assert r.exitcode == exitcode, error(r.output)
1510\|  
1511\|          if messages is None:
1512\|              messages = []

Results

Test Name Result Duration
/dns OK 1m 23s
/dns/lookup XFail 135ms
/dns/ipv6 OK 304ms
/dns/ipv6/Test host regexp multiple ptr v4 fails with wrong resolution OK 111ms
/dns/ipv6/Test host regexp multiple ptr v4 OK 90ms
/dns/ipv6/Test host regexp multiple ptr v6 OK 92ms

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232