Copyright 2023, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..
| Date | Dec 26, 2023 12:37 |
| Duration | 1h 8m |
| Framework | TestFlows 2.0.231130.1212236 |
Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#/
| project | Altinity/ClickHouse |
| project.id | 159717931 |
| package | https://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_aarch64/clickhouse-common-static_23.8.8.21.altinitystable_arm64.deb |
| version | 23.8.8.21.altinitystable |
| user.name | Enmk |
| repository | https://github.com/Altinity/clickhouse-regression |
| commit.hash | 09db6160aac30e37169797b73fac77b4cbca41c6 |
| job.id | 7328846900 |
| job.url | https://github.com/Altinity/ClickHouse/actions/runs/7328846900 |
| arch | aarch64 |
| node | clickhouse1 |
| local | True |
| clickhouse_version | None |
| clickhouse_binary_path | https://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_aarch64/clickhouse-common-static_23.8.8.21.altinitystable_arm64.deb |
| stress | False |
| collect_service_logs | True |
| storages | None |
| minio_uri | http://minio1:9001 |
| minio_root_user | minio |
| minio_root_password | minio123 |
| aws_s3_bucket | None |
| aws_s3_region | Secret(name='aws_s3_region') |
| aws_s3_key_id | Secret(name='aws_s3_key_id') |
| aws_s3_access_key | Secret(name='aws_s3_access_key') |
| gcs_uri | None |
| gcs_key_id | None |
| gcs_key_secret | None |
| Units | Skip | OK | Fail | XFail | |
|---|---|---|---|---|---|
| Modules | |||||
| Suites | |||||
| Features | |||||
| Scenarios | |||||
| Checks | |||||
| Examples | |||||
| Steps |
| Test Name | Result | Message |
|---|---|---|
| /parquet/chunked array | XFail 19s 336ms Not supported | AssertionError
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/chunked_array.py", line 30, in feature
node.query(
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 802, in query
assert False, error(r.output)
AssertionError: Oops! Assertion failed
The following assertion was not satisfied
assert False, error(r.output)
Description
Error on processing query: Code: 33. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File: data for INSERT was parsed from file. (CANNOT_READ_ALL_DATA) (version 23.8.8.21.altinitystable (altinity build))
(query: INSERT INTO table_a50ed9a5_a3f0_11ee_8756_cf7e8f57e04e FROM INFILE '/var/lib/clickhouse/user_files/chunked_array_test_file.parquet' FORMAT Parquet)
Assertion values
assert False, error(r.output)
^ is False
Where
File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 802 in 'query'
794\| assert message in r.output, error(r.output)
795\|
796\| if not ignore_exception:
797\| if message is None or "Exception:" not in message:
798\| with Then("check if output has exception") if steps else NullStep():
799\| if "Exception:" in r.output:
800\| if raise_on_exception:
801\| raise QueryRuntimeException(r.output)
802\|> assert False, error(r.output)
803\|
804\| return r
805\| |
| /parquet/datatypes/large string map | XFail 8s 169ms Will fail until the, https://github.com/apache/arrow/pull/35825, gets merged. | AssertionError
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 877, in feature
scenario()
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 762, in large_string_map
import_export(snapshot_name="large_string_map_structure", import_file=import_file)
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/outline.py", line 28, in import_export
node.query(
File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 802, in query
assert False, error(r.output)
AssertionError: Oops! Assertion failed
The following assertion was not satisfied
assert False, error(r.output)
Description
Received exception from server (version 23.8.8):
Code: 33. DB::Exception: Received from localhost:9000. DB::ParsingException. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File. (CANNOT_READ_ALL_DATA)
(query: CREATE TABLE table_9b23ca82_a3f1_11ee_8756_cf7e8f57e04e
ENGINE = MergeTree
ORDER BY tuple() AS SELECT * FROM file('arrow/large_string_map.brotli.parquet', Parquet) LIMIT 100
)
Assertion values
assert False, error(r.output)
^ is False
Where
File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 802 in 'query'
794\| assert message in r.output, error(r.output)
795\|
796\| if not ignore_exception:
797\| if message is None or "Exception:" not in message:
798\| with Then("check if output has exception") if steps else NullStep():
799\| if "Exception:" in r.output:
800\| if raise_on_exception:
801\| raise QueryRuntimeException(r.output)
802\|> assert False, error(r.output)
803\|
804\| return r
805\| |
| Test Name | Result | Duration |
|---|---|---|
| /parquet | OK | 1h 8m |
| /parquet/file | OK | 1h 4m |
| /parquet/query | OK | 1h 3m |
| /parquet/list in multiple chunks | OK | 1m 15s |
| /parquet/url | OK | 1h 5m |
| /parquet/query/compression type | OK | 1h 3m |
| /parquet/file/engine | OK | 1h 4m |
| /parquet/query/compression type/=NONE | OK | 1h 3m |
| /parquet/query/compression type/=GZIP | OK | 1h 3m |
| /parquet/file/function | OK | 30m 25s |
| /parquet/query/compression type/=LZ4 | OK | 1h 3m |
| /parquet/query/compression type/=GZIP /insert into memory table from file | OK | 13m 38s |
| /parquet/file/engine/insert into engine | OK | 30m 6s |
| /parquet/query/compression type/=NONE /insert into memory table from file | OK | 14m 2s |
| /parquet/file/engine/select from engine | OK | 14m 2s |
| /parquet/file/engine/engine to file to engine | OK | 40m 28s |
| /parquet/file/engine/insert into engine from file | OK | 27m 27s |
| /parquet/file/engine/engine select output to file | OK | 1h 4m |
| /parquet/query/compression type/=LZ4 /insert into memory table from file | OK | 13m 40s |
| /parquet/file/function/insert into function manual cast types | OK | 24m 53s |
| /parquet/file/function/insert into function auto cast types | OK | 30m 25s |
| /parquet/file/function/select from function manual cast types | OK | 19m 23s |
| /parquet/file/function/select from function auto cast types | OK | 13m 43s |
| /parquet/url/engine | OK | 1h 4m |
| /parquet/url/engine/insert into engine | OK | 34m 58s |
| /parquet/url/function | OK | 35m 40s |
| /parquet/url/function/insert into function | OK | 24m 46s |
| /parquet/url/engine/select from engine | OK | 14m 1s |
| /parquet/url/engine/engine to file to engine | OK | 40m 43s |
| /parquet/url/engine/insert into engine from file | OK | 37m 49s |
| /parquet/url/function/select from function manual cast types | OK | 35m 40s |
| /parquet/url/function/select from function auto cast types | OK | 22m 53s |
| /parquet/url/engine/engine select output to file | OK | 1h 4m |
| /parquet/mysql | OK | 1m 48s |
| /parquet/mysql/compression type | OK | 1m 47s |
| /parquet/mysql/compression type/=NONE | OK | 1m 46s |
| /parquet/mysql/compression type/=NONE /mysql engine to parquet file to mysql engine | OK | 1m 11s |
| /parquet/mysql/compression type/=GZIP | OK | 1m 46s |
| /parquet/mysql/compression type/=GZIP /mysql engine to parquet file to mysql engine | OK | 1m 11s |
| /parquet/mysql/compression type/=LZ4 | OK | 1m 47s |
| /parquet/mysql/compression type/=LZ4 /mysql engine to parquet file to mysql engine | OK | 1m 12s |
| /parquet/mysql/compression type/=GZIP /mysql function to parquet file to mysql function | OK | 34s 857ms |
| /parquet/mysql/compression type/=NONE /mysql function to parquet file to mysql function | OK | 34s 393ms |
| /parquet/mysql/compression type/=LZ4 /mysql function to parquet file to mysql function | OK | 35s 126ms |
| /parquet/postgresql | OK | 1m 36s |
| /parquet/postgresql/compression type | OK | 1m 35s |
| /parquet/postgresql/compression type/=NONE | OK | 1m 35s |
| /parquet/postgresql/compression type/=GZIP | OK | 1m 35s |
| /parquet/postgresql/compression type/=LZ4 | OK | 1m 35s |
| /parquet/postgresql/compression type/=LZ4 /postgresql engine to parquet file to postgresql engine | OK | 57s 711ms |
| /parquet/postgresql/compression type/=GZIP /postgresql engine to parquet file to postgresql engine | OK | 58s 512ms |
| /parquet/postgresql/compression type/=NONE /postgresql engine to parquet file to postgresql engine | OK | 58s 185ms |
| /parquet/postgresql/compression type/=LZ4 /postgresql function to parquet file to postgresql function | OK | 37s 547ms |
| /parquet/postgresql/compression type/=NONE /postgresql function to parquet file to postgresql function | OK | 37s 124ms |
| /parquet/postgresql/compression type/=GZIP /postgresql function to parquet file to postgresql function | OK | 37s 6ms |
| /parquet/remote | OK | 30m 10s |
| /parquet/remote/compression type | OK | 30m 10s |
| /parquet/remote/compression type/=NONE | OK | 30m 7s |
| /parquet/remote/compression type/=GZIP | OK | 30m 9s |
| /parquet/remote/compression type/=LZ4 | OK | 30m 5s |
| /parquet/remote/compression type/=NONE /outline | OK | 30m 7s |
| /parquet/remote/compression type/=LZ4 /outline | OK | 30m 4s |
| /parquet/remote/compression type/=GZIP /outline | OK | 30m 9s |
| /parquet/remote/compression type/=LZ4 /outline/insert into function | OK | 12m 43s |
| /parquet/remote/compression type/=NONE /outline/insert into function | OK | 12m 46s |
| /parquet/remote/compression type/=GZIP /outline/insert into function | OK | 12m 48s |
| /parquet/query/compression type/=GZIP /insert into mergetree table from file | OK | 8m 0s |
| /parquet/query/compression type/=LZ4 /insert into mergetree table from file | OK | 8m 8s |
| /parquet/query/compression type/=NONE /insert into mergetree table from file | OK | 7m 59s |
| /parquet/remote/compression type/=LZ4 /outline/select from function | OK | 17m 21s |
| /parquet/remote/compression type/=NONE /outline/select from function | OK | 17m 20s |
| /parquet/remote/compression type/=GZIP /outline/select from function | OK | 17m 21s |
| /parquet/query/compression type/=GZIP /insert into replicated mergetree table from file | OK | 5m 29s |
| /parquet/query/compression type/=LZ4 /insert into replicated mergetree table from file | OK | 5m 21s |
| /parquet/query/compression type/=NONE /insert into replicated mergetree table from file | OK | 5m 27s |
| /parquet/query/compression type/=GZIP /insert into distributed table from file | OK | 4m 23s |
| /parquet/query/compression type/=LZ4 /insert into distributed table from file | OK | 4m 22s |
| /parquet/query/compression type/=NONE /insert into distributed table from file | OK | 4m 11s |
| /parquet/query/compression type/=LZ4 /select from memory table into file | OK | 8m 31s |
| /parquet/query/compression type/=GZIP /select from memory table into file | OK | 8m 35s |
| /parquet/query/compression type/=NONE /select from memory table into file | OK | 8m 26s |
| /parquet/chunked array | XFail | 19s 336ms |
| /parquet/broken | OK | 458ms |
| /parquet/broken/file | Skip | 14ms |
| /parquet/broken/read broken bigint | Skip | 20ms |
| /parquet/broken/read broken date | Skip | 45ms |
| /parquet/broken/read broken int | Skip | 72ms |
| /parquet/broken/read broken smallint | Skip | 9ms |
| /parquet/broken/read broken timestamp ms | Skip | 12ms |
| /parquet/broken/read broken timestamp us | Skip | 1ms |
| /parquet/broken/read broken tinyint | Skip | 31ms |
| /parquet/broken/read broken ubigint | Skip | 47ms |
| /parquet/broken/read broken uint | Skip | 14ms |
| /parquet/broken/read broken usmallint | Skip | 17ms |
| /parquet/broken/read broken utinyint | Skip | 6ms |
| /parquet/broken/string | Skip | 14ms |
| /parquet/encoding | OK | 1m 4s |
| /parquet/encoding/deltabytearray1 | OK | 8s 950ms |
| /parquet/encoding/deltabytearray2 | OK | 9s 458ms |
| /parquet/encoding/deltalengthbytearray | OK | 10s 262ms |
| /parquet/encoding/dictionary | OK | 8s 874ms |
| /parquet/encoding/plain | OK | 8s 12ms |
| /parquet/encoding/plainrlesnappy | OK | 11s 379ms |
| /parquet/encoding/rleboolean | OK | 7s 205ms |
| /parquet/compression | OK | 2m 25s |
| /parquet/compression/arrow snappy | OK | 7s 167ms |
| /parquet/compression/brotli | OK | 6s 315ms |
| /parquet/compression/gzippages | OK | 14s 214ms |
| /parquet/compression/largegzip | OK | 6s 559ms |
| /parquet/compression/lz4 hadoop | OK | 6s 779ms |
| /parquet/compression/lz4 hadoop large | OK | 7s 263ms |
| /parquet/compression/lz4 non hadoop | OK | 6s 864ms |
| /parquet/compression/lz4 raw | OK | 7s 440ms |
| /parquet/compression/lz4 raw large | OK | 7s 31ms |
| /parquet/compression/lz4pages | OK | 14s 428ms |
| /parquet/compression/nonepages | OK | 13s 888ms |
| /parquet/compression/snappypages | OK | 14s 115ms |
| /parquet/compression/snappyplain | OK | 6s 791ms |
| /parquet/compression/snappyrle | OK | 6s 143ms |
| /parquet/compression/zstd | OK | 6s 520ms |
| /parquet/compression/zstdpages | OK | 14s 154ms |
| /parquet/datatypes | OK | 6m 2s |
| /parquet/datatypes/arrowtimestamp | OK | 7s 28ms |
| /parquet/datatypes/arrowtimestampms | OK | 6s 993ms |
| /parquet/datatypes/binary | OK | 6s 799ms |
| /parquet/datatypes/binary string | OK | 6s 601ms |
| /parquet/datatypes/blob | OK | 6s 802ms |
| /parquet/datatypes/boolean | OK | 6s 475ms |
| /parquet/datatypes/byte array | OK | 6s 868ms |
| /parquet/datatypes/columnname | OK | 6s 483ms |
| /parquet/datatypes/columnwithnull | OK | 6s 890ms |
| /parquet/datatypes/columnwithnull2 | OK | 6s 925ms |
| /parquet/datatypes/date | OK | 7s 178ms |
| /parquet/datatypes/decimal with filter | OK | 6s 706ms |
| /parquet/datatypes/decimalvariousfilters | OK | 7s 93ms |
| /parquet/query/compression type/=LZ4 /select from mergetree table into file | OK | 5m 37s |
| /parquet/query/compression type/=NONE /select from mergetree table into file | OK | 5m 35s |
| /parquet/query/compression type/=GZIP /select from mergetree table into file | OK | 5m 35s |
| /parquet/datatypes/decimalwithfilter2 | OK | 6s 158ms |
| /parquet/datatypes/enum | OK | 13s 315ms |
| /parquet/datatypes/enum2 | OK | 7s 630ms |
| /parquet/datatypes/fixed length decimal | OK | 6s 349ms |
| /parquet/datatypes/fixed length decimal legacy | OK | 5s 859ms |
| /parquet/datatypes/fixedstring | OK | 5s 973ms |
| /parquet/datatypes/h2oai | OK | 6s 52ms |
| /parquet/datatypes/hive | OK | 11s 540ms |
| /parquet/datatypes/int32 | OK | 6s 165ms |
| /parquet/datatypes/int32 decimal | OK | 6s 106ms |
| /parquet/datatypes/int64 | OK | 6s 197ms |
| /parquet/datatypes/int64 decimal | OK | 6s 25ms |
| /parquet/datatypes/json | OK | 6s 682ms |
| /parquet/datatypes/large string map | XFail | 8s 169ms |
| /parquet/datatypes/largedouble | OK | 6s 92ms |
| /parquet/datatypes/manydatatypes | OK | 5s 884ms |
| /parquet/datatypes/manydatatypes2 | OK | 6s 304ms |
| /parquet/datatypes/maps | OK | 5s 848ms |
| /parquet/datatypes/nameswithemoji | OK | 6s 83ms |
| /parquet/datatypes/nandouble | OK | 6s 38ms |
| /parquet/datatypes/negativeint64 | OK | 5s 862ms |
| /parquet/datatypes/nullbyte | OK | 5s 943ms |
| /parquet/datatypes/nullbytemultiple | OK | 6s 260ms |
| /parquet/datatypes/nullsinid | OK | 6s 180ms |
| /parquet/datatypes/pandasdecimal | OK | 5s 786ms |
| /parquet/datatypes/pandasdecimaldate | OK | 5s 719ms |
| /parquet/datatypes/parquetgo | OK | 6s 82ms |
| /parquet/datatypes/selectdatewithfilter | OK | 13s 733ms |
| /parquet/datatypes/singlenull | OK | 6s 320ms |
| /parquet/datatypes/sparkv21 | OK | 5s 882ms |
| /parquet/datatypes/sparkv22 | OK | 6s 17ms |
| /parquet/datatypes/statdecimal | OK | 5s 963ms |
| /parquet/datatypes/string | OK | 6s 323ms |
| /parquet/datatypes/string int list inconsistent offset multiple batches | Skip | 2ms |
| /parquet/datatypes/stringtypes | OK | 6s 294ms |
| /parquet/datatypes/struct | OK | 6s 278ms |
| /parquet/datatypes/supporteduuid | OK | 5s 750ms |
| /parquet/datatypes/timestamp1 | OK | 6s 340ms |
| /parquet/datatypes/timestamp2 | OK | 5s 959ms |
| /parquet/datatypes/timezone | OK | 5s 872ms |
| /parquet/datatypes/unsigned | OK | 12s 196ms |
| /parquet/datatypes/unsupportednull | OK | 216ms |
| /parquet/complex | OK | 2m 9s |
| /parquet/complex/arraystring | OK | 6s 9ms |
| /parquet/complex/big tuple with nulls | OK | 6s 480ms |
| /parquet/complex/bytearraydictionary | OK | 6s 164ms |
| /parquet/complex/complex null | OK | 6s 531ms |
| /parquet/complex/lagemap | OK | 5s 978ms |
| /parquet/complex/largenestedarray | OK | 6s 132ms |
| /parquet/complex/largestruct | OK | 6s 120ms |
| /parquet/complex/largestruct2 | OK | 6s 403ms |
| /parquet/complex/largestruct3 | OK | 6s 208ms |
| /parquet/complex/list | OK | 6s 584ms |
| /parquet/query/compression type/=LZ4 /select from replicated mergetree table into file | OK | 5m 32s |
| /parquet/query/compression type/=NONE /select from replicated mergetree table into file | OK | 5m 30s |
| /parquet/query/compression type/=GZIP /select from replicated mergetree table into file | OK | 5m 31s |
| /parquet/complex/nested array | OK | 6s 369ms |
| /parquet/complex/nested map | OK | 12s 104ms |
| /parquet/complex/nestedallcomplex | OK | 6s 76ms |
| /parquet/complex/nestedarray2 | OK | 6s 140ms |
| /parquet/complex/nestedstruct | OK | 6s 37ms |
| /parquet/complex/nestedstruct2 | OK | 5s 878ms |
| /parquet/complex/nestedstruct3 | OK | 6s 25ms |
| /parquet/complex/nestedstruct4 | OK | 6s 78ms |
| /parquet/complex/tupleofnulls | OK | 5s 979ms |
| /parquet/complex/tuplewithdatetime | OK | 6s 176ms |
| /parquet/indexing | OK | 6s 401ms |
| /parquet/indexing/bigtuplewithnulls | OK | 6s 399ms |
| /parquet/cache | OK | 11s 917ms |
| /parquet/cache/cache1 | OK | 5s 876ms |
| /parquet/cache/cache2 | OK | 6s 39ms |
| /parquet/glob | OK | 44s 142ms |
| /parquet/glob/fastparquet globs | OK | 1s 622ms |
| /parquet/glob/glob1 | OK | 1s 603ms |
| /parquet/glob/glob2 | OK | 1s 829ms |
| /parquet/glob/glob with multiple elements | OK | 404ms |
| /parquet/glob/million extensions | OK | 38s 679ms |
| /parquet/rowgroups | OK | 12s 43ms |
| /parquet/rowgroups/manyrowgroups | OK | 5s 991ms |
| /parquet/rowgroups/manyrowgroups2 | OK | 6s 48ms |
| /parquet/encrypted | Skip | 5ms |
| /parquet/fastparquet | OK | 2m 52s |
| /parquet/fastparquet/airlines | OK | 5s 931ms |
| /parquet/fastparquet/baz | OK | 6s 413ms |
| /parquet/fastparquet/empty date | OK | 18s 685ms |
| /parquet/fastparquet/evo | OK | 36s 114ms |
| /parquet/fastparquet/fastparquet | OK | 1m 45s |
| /parquet/query/compression type/=LZ4 /select from distributed table into file | OK | 6m 5s |
| /parquet/query/compression type/=NONE /select from distributed table into file | OK | 6m 4s |
| /parquet/query/compression type/=GZIP /select from distributed table into file | OK | 6m 3s |
| /parquet/query/compression type/=NONE /select from mat view into file | OK | 4m 48s |
| /parquet/query/compression type/=GZIP /select from mat view into file | OK | 4m 47s |
| /parquet/query/compression type/=LZ4 /select from mat view into file | OK | 4m 48s |
| /parquet/query/compression type/=GZIP /insert into table with projection from file | OK | 1m 36s |
| /parquet/query/compression type/=NONE /insert into table with projection from file | OK | 1m 37s |
| /parquet/query/compression type/=LZ4 /insert into table with projection from file | OK | 1m 36s |
Generated by TestFlows Open-Source Test Framework v2.0.231130.1212236