Copyright 2024, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Dns Test Run Report

DateJul 22, 2024 9:24
Duration2m 28s
Framework TestFlows 2.0.240705.1133204

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/b6642564dbf296d6e55b907d7af6c8087470b672/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
version24.3.5.47.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashc5e1513a2214ee33696c29717935e0a94989ac2a
job.id10037417827
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/10037417827
archaarch64
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.3/b6642564dbf296d6e55b907d7af6c8087470b672/package_aarch64/clickhouse-common-static_24.3.5.47.altinitystable_arm64.deb
keeper_binary_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerFalse
reuse_envFalse

Summary

83.3%OK
16.7%Known

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
4
3
1
Steps
116
107
2
4
3

Known Fails

Test NameResultMessage
/dns/lookupXFail 228ms
https://github.com/ClickHouse/ClickHouse/issues/17202
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 60, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/argparser.py", line 145, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 55, in regression
    Scenario(run=load("dns.tests.lookup.scenario", "scenario"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../dns/tests/lookup/scenario.py", line 48, in scenario
    cluster.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py", line 1960, in command
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Bash: regression/dns/tests/lookup/example.com: No such file or directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py', line 1960 in 'command'

1952\|                  Then(f"exitcode should be {exitcode}", format_name=False)
1953\|                  if steps
1954\|                  else NullStep()
1955\|              ):
1956\|                  if str(exitcode).startswith("!="):
1957\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
1958\|                      assert r.exitcode != exitcode, error(r.output)
1959\|                  else:
1960\|>                     assert r.exitcode == exitcode, error(r.output)
1961\|  
1962\|          if messages is None:
1963\|              messages = []

Results

Test Name Result Duration
/dns OK 2m 28s
/dns/lookup XFail 228ms
/dns/ipv6 OK 493ms
/dns/ipv6/Test host regexp multiple ptr v4 fails with wrong resolution OK 204ms
/dns/ipv6/Test host regexp multiple ptr v4 OK 137ms
/dns/ipv6/Test host regexp multiple ptr v6 OK 133ms

Generated by TestFlows Open-Source Test Framework v2.0.240705.1133204