Document status - Public


QA Software Build Report

ClickHouse 23.3.13.7.altinitystable / x86_64 & aarch64

(c) 2023 Altinity Inc. All Rights Reserved.

Approval

Status: Approved for release by QA

Reviewed by: vzakaznikov@altinity.com

Date: Thu 05 Oct 2023 04:26:35 PM EDT

Table of Contents

Test Results

Stage Status Note
x86_64
Integration Pass with known fails
Stateful Pass
Stateless Pass
TestFlows Pass
Trivy Pass
Scout Pass
Aarch64
Stateful Pass
Stateless Pass
TestFlows Pass with known fails
Trivy Pass
Scout Pass

Results https://altinity-test-reports.s3.amazonaws.com/index.html#builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/
GitLab Pipeline https://gitlab.com/altinity-qa/clickhouse/cicd/release/-/pipelines/1026936961
GitHub Actions https://github.com/Altinity/ClickHouse/actions/runs/6416627213

Results Analysis

x86_64

Integration x86_64 Results

Results

https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/integration/integration_results_1.html
https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/integration/integration_results_2.html

Fails

Test: /integration/test_cgroup_limit/test.py::test_cgroup_cpu_limit


Reason:

____________________________ test_cgroup_cpu_limit _____________________________
[gw4] linux -- Python 3.8.10 /usr/bin/python3

    def test_cgroup_cpu_limit():
        for num_cpus in (1, 2, 4, 2.8):
>           result = run_with_cpu_limit(
                "clickhouse local -q \"select value from system.settings where name='max_threads'\"",
                num_cpus,
            )

test_cgroup_limit/test.py:43: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
test_cgroup_limit/test.py:38: in run_with_cpu_limit
    return run_command_in_container(cmd, *args)
test_cgroup_limit/test.py:19: in run_command_in_container
    return subprocess.check_output(
/usr/lib/python3.8/subprocess.py:415: in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

input = None, capture_output = False, timeout = None, check = True
popenargs = (['docker', 'run', '--rm', '--cpus', '1', '--volume', ...],)
kwargs = {'stdout': -1}, process = <subprocess.Popen object at 0x7fcd5a312640>
stdout = b'', stderr = None, retcode = 125

    def run(*popenargs,
            input=None, capture_output=False, timeout=None, check=False, **kwargs):
        """Run command with arguments and return a CompletedProcess instance.

        The returned instance will have attributes args, returncode, stdout and
        stderr. By default, stdout and stderr are not captured, and those attributes
        will be None. Pass stdout=PIPE and/or stderr=PIPE in order to capture them.

        If check is True and the exit code was non-zero, it raises a
        CalledProcessError. The CalledProcessError object will have the return code
        in the returncode attribute, and output & stderr attributes if those streams
        were captured.

        If timeout is given, and the process takes too long, a TimeoutExpired
        exception will be raised.

        There is an optional argument "input", allowing you to
        pass bytes or a string to the subprocess's stdin.  If you use this argument
        you may not also use the Popen constructor's "stdin" argument, as
        it will be used internally.

        By default, all communication is in bytes, and therefore any "input" should
        be bytes, and the stdout and stderr will be bytes. If in text mode, any
        "input" should be a string, and stdout and stderr will be strings decoded
        according to locale encoding, or by "encoding" if set. Text mode is
        triggered by setting any of text, encoding, errors or universal_newlines.

        The other arguments are the same as for the Popen constructor.
        """
        if input is not None:
            if kwargs.get('stdin') is not None:
                raise ValueError('stdin and input arguments may not both be used.')
            kwargs['stdin'] = PIPE

        if capture_output:
            if kwargs.get('stdout') is not None or kwargs.get('stderr') is not None:
                raise ValueError('stdout and stderr arguments may not be used '
                                 'with capture_output.')
            kwargs['stdout'] = PIPE
            kwargs['stderr'] = PIPE

        with Popen(*popenargs, **kwargs) as process:
            try:
                stdout, stderr = process.communicate(input, timeout=timeout)
            except TimeoutExpired as exc:
                process.kill()
                if _mswindows:
                    # Windows accumulates the output in a single blocking
                    # read() call run on child threads, with the timeout
                    # being done in a join() on those threads.  communicate()
                    # _after_ kill() is required to collect that and add it
                    # to the exception.
                    exc.stdout, exc.stderr = process.communicate()
                else:
                    # POSIX _communicate already populated the output so
                    # far into the TimeoutExpired exception.
                    process.wait()
                raise
            except:  # Including KeyboardInterrupt, communicate handled that.
                process.kill()
                # We don't call process.wait() as .__exit__ does that for us.
                raise
            retcode = process.poll()
            if check and retcode:
>               raise CalledProcessError(retcode, process.args,
                                         output=stdout, stderr=stderr)
E               subprocess.CalledProcessError: Command '['docker', 'run', '--rm', '--cpus', '1', '--volume', '/clickhouse:/usr/bin/clickhouse', 'ubuntu:20.04', 'sh', '-c', 'clickhouse local -q "select value from system.settings where name=\'max_threads\'"']' returned non-zero exit status 125.



Comment: Misconfiguration: 1 CPU/hardware thread available to the CH instead of at least 2.
Status: FAIL (OK to fail)

Stateful x86_64 Results

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/stateful/amd64/stateful_results.html

Stateless x86_64 Results

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/stateless/amd64/stateless_results.html

TestFlows x86_64 Results

Passed:
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- Benchmark AWS
- Benchmark Minio
- Benchmark GCS
- ClickHouse Keeper
- ClickHouse Keeper SSL
- DateTime64 Extended Range
- Data Types
- Disk Level Encryption
- DNS
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Lightweight Delete
- Parquet
- Part Moves Between Shards
- RBAC
- Selects
- SSL Server
- S3 AWS
- S3 Minio
- S3 GCS
- Tiered Storage
- Tiered Storage AWS
- Tiered Storage Minio
- Tiered Storage GCS
- Window Functions

Trivy x86_64 Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/staging-docker-trivy-ubuntu-amd64/results.html

Scout x86_64 Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/staging-docker-scout-ubuntu-amd64/results.html

Aarch64

Stateful Aarch64 Results

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/stateful/aarch64/stateful_results.html

Stateless Aarch64 Results

Results https://s3.amazonaws.com/altinity-test-reports/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/stateless/aarch64/stateless_results.html

TestFlows Aarch64 Results

Passed:
- Aes Encryption
- Aggregate Functions
- Atomic Insert
- Base58
- Benchmark AWS
- Benchmark Minio
- Benchmark GCS
- ClickHouse Keeper
- ClickHouse Keeper
- DateTime64 Extended Range
- Data Types
- Disk Level Encryption
- DNS
- Engines
- Example
- Extended Precision Data Types
- Kafka
- Kerberos
- LDAP Authentication
- LDAP External User Directory
- LDAP Role Mapping
- Lightweight Delete
- Part Moves Between Shards
- Selects
- SSL Server
- S3 AWS
- S3 Minio
- S3 GCS
- Tiered Storage
- Tiered Storage AWS
- Tiered Storage Minio
- Tiered Storage GCS
- Window Functions

Failed:
- RBAC
OK to Fail. Successful run: https://github.com/Altinity/clickhouse-regression/actions/runs/6422248369

Trivy Aarch64 Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/staging-docker-trivy-ubuntu-arm64/results.html

Scout Aarch64 Results

Results https://altinity-test-reports.s3.amazonaws.com/builds/stable/v23.3.13.7.altinitystable/2023-10-05T14-21-32.902/staging-docker-scout-ubuntu-arm64/results.html