Parquet Test Run Report

DateDec 26, 2023 12:45
Duration43m 47s
Framework TestFlows 2.0.231130.1212236

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
version23.8.8.21.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash09db6160aac30e37169797b73fac77b4cbca41c6
job.id7328846900
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/7328846900
archx86_64
nodeclickhouse1
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/57762a45dd8d7579a37ae9643654cde6896312dc/package_release/clickhouse-common-static_23.8.8.21.altinitystable_amd64.deb
stressFalse
collect_service_logsTrue
storagesNone
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

100%OK
<1%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
39
1
37
1
Features
37
1
35
1
Scenarios
215
14
200
1
Checks
59678
59678
Examples
12
12
Steps
354007
353943
4
60

Known Fails

Test NameResultMessage
/parquet/chunked arrayXFail 12s 410ms
Not supported
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/chunked_array.py", line 30, in feature
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 802, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Error on processing query: Code: 33. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File: data for INSERT was parsed from file. (CANNOT_READ_ALL_DATA) (version 23.8.8.21.altinitystable (altinity build))
(query: INSERT INTO table_ab7b54f9_a3ef_11ee_bc62_598b3e470fce FROM INFILE '/var/lib/clickhouse/user_files/chunked_array_test_file.parquet' FORMAT Parquet)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 802 in 'query'

794\|                  assert message in r.output, error(r.output)
795\|  
796\|          if not ignore_exception:
797\|              if message is None or "Exception:" not in message:
798\|                  with Then("check if output has exception") if steps else NullStep():
799\|                      if "Exception:" in r.output:
800\|                          if raise_on_exception:
801\|                              raise QueryRuntimeException(r.output)
802\|>                         assert False, error(r.output)
803\|  
804\|          return r
805\|
/parquet/datatypes/large string mapXFail 7s 731ms
Will fail until the, https://github.com/apache/arrow/pull/35825, gets merged.
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 877, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 762, in large_string_map
    import_export(snapshot_name="large_string_map_structure", import_file=import_file)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/outline.py", line 28, in import_export
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 802, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 23.8.8):
Code: 33. DB::Exception: Received from localhost:9000. DB::ParsingException. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File. (CANNOT_READ_ALL_DATA)
(query: CREATE TABLE table_e0de4abf_a3ef_11ee_bc62_598b3e470fce
            ENGINE = MergeTree
            ORDER BY tuple() AS SELECT * FROM file('arrow/large_string_map.brotli.parquet', Parquet) LIMIT 100
            )

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 802 in 'query'

794\|                  assert message in r.output, error(r.output)
795\|  
796\|          if not ignore_exception:
797\|              if message is None or "Exception:" not in message:
798\|                  with Then("check if output has exception") if steps else NullStep():
799\|                      if "Exception:" in r.output:
800\|                          if raise_on_exception:
801\|                              raise QueryRuntimeException(r.output)
802\|>                         assert False, error(r.output)
803\|  
804\|          return r
805\|

Results

Test Name Result Duration
/parquet OK 43m 47s
/parquet/file OK 40m 1s
/parquet/file/engine OK 40m 1s
/parquet/file/function OK 18m 31s
/parquet/file/engine/insert into engine OK 17m 52s
/parquet/query OK 38m 22s
/parquet/query/compression type OK 38m 22s
/parquet/file/function/insert into function manual cast types OK 14m 49s
/parquet/file/engine/select from engine OK 8m 20s
/parquet/file/function/insert into function auto cast types OK 18m 31s
/parquet/query/compression type/=NONE OK 38m 22s
/parquet/query/compression type/=NONE /insert into memory table from file OK 8m 9s
/parquet/file/engine/engine to file to engine OK 24m 12s
/parquet/file/function/select from function manual cast types OK 8m 58s
/parquet/file/engine/insert into engine from file OK 16m 20s
/parquet/query/compression type/=GZIP OK 38m 22s
/parquet/file/function/select from function auto cast types OK 8m 22s
/parquet/query/compression type/=GZIP /insert into memory table from file OK 8m 7s
/parquet/file/engine/engine select output to file OK 40m 1s
/parquet/list in multiple chunks OK 26s 473ms
/parquet/query/compression type/=LZ4 OK 38m 22s
/parquet/url OK 41m 12s
/parquet/query/compression type/=LZ4 /insert into memory table from file OK 8m 8s
/parquet/url/engine OK 40m 35s
/parquet/url/function OK 14m 47s
/parquet/url/engine/insert into engine OK 21m 17s
/parquet/url/function/insert into function OK 14m 47s
/parquet/url/engine/select from engine OK 8m 24s
/parquet/url/engine/engine to file to engine OK 24m 27s
/parquet/url/function/select from function manual cast types OK 14m 40s
/parquet/url/engine/insert into engine from file OK 21m 48s
/parquet/url/function/select from function auto cast types OK 13m 35s
/parquet/url/engine/engine select output to file OK 40m 35s
/parquet/mysql OK 38s 356ms
/parquet/mysql/compression type OK 38s 315ms
/parquet/mysql/compression type/=NONE OK 37s 974ms
/parquet/mysql/compression type/=NONE /mysql engine to parquet file to mysql engine OK 22s 381ms
/parquet/mysql/compression type/=GZIP OK 38s 277ms
/parquet/mysql/compression type/=LZ4 OK 37s 790ms
/parquet/mysql/compression type/=LZ4 /mysql engine to parquet file to mysql engine OK 22s 764ms
/parquet/mysql/compression type/=GZIP /mysql engine to parquet file to mysql engine OK 22s 886ms
/parquet/mysql/compression type/=NONE /mysql function to parquet file to mysql function OK 15s 562ms
/parquet/mysql/compression type/=LZ4 /mysql function to parquet file to mysql function OK 14s 929ms
/parquet/mysql/compression type/=GZIP /mysql function to parquet file to mysql function OK 15s 306ms
/parquet/postgresql OK 43s 869ms
/parquet/postgresql/compression type OK 43s 812ms
/parquet/postgresql/compression type/=LZ4 OK 42s 74ms
/parquet/postgresql/compression type/=NONE OK 43s 731ms
/parquet/postgresql/compression type/=GZIP OK 43s 126ms
/parquet/postgresql/compression type/=NONE /postgresql engine to parquet file to postgresql engine OK 25s 981ms
/parquet/postgresql/compression type/=LZ4 /postgresql engine to parquet file to postgresql engine OK 25s 120ms
/parquet/postgresql/compression type/=GZIP /postgresql engine to parquet file to postgresql engine OK 25s 427ms
/parquet/postgresql/compression type/=LZ4 /postgresql function to parquet file to postgresql function OK 16s 806ms
/parquet/postgresql/compression type/=GZIP /postgresql function to parquet file to postgresql function OK 17s 501ms
/parquet/postgresql/compression type/=NONE /postgresql function to parquet file to postgresql function OK 17s 508ms
/parquet/remote OK 18m 34s
/parquet/remote/compression type OK 18m 34s
/parquet/remote/compression type/=LZ4 OK 18m 33s
/parquet/remote/compression type/=LZ4 /outline OK 18m 33s
/parquet/remote/compression type/=NONE OK 18m 34s
/parquet/remote/compression type/=LZ4 /outline/insert into function OK 8m 41s
/parquet/remote/compression type/=GZIP OK 18m 31s
/parquet/remote/compression type/=NONE /outline OK 18m 34s
/parquet/remote/compression type/=NONE /outline/insert into function OK 8m 41s
/parquet/remote/compression type/=GZIP /outline OK 18m 31s
/parquet/remote/compression type/=GZIP /outline/insert into function OK 8m 43s
/parquet/query/compression type/=GZIP /insert into mergetree table from file OK 4m 57s
/parquet/query/compression type/=LZ4 /insert into mergetree table from file OK 4m 56s
/parquet/query/compression type/=NONE /insert into mergetree table from file OK 4m 57s
/parquet/remote/compression type/=LZ4 /outline/select from function OK 9m 52s
/parquet/remote/compression type/=NONE /outline/select from function OK 9m 53s
/parquet/remote/compression type/=GZIP /outline/select from function OK 9m 48s
/parquet/query/compression type/=GZIP /insert into replicated mergetree table from file OK 3m 9s
/parquet/query/compression type/=LZ4 /insert into replicated mergetree table from file OK 3m 9s
/parquet/query/compression type/=NONE /insert into replicated mergetree table from file OK 3m 11s
/parquet/query/compression type/=GZIP /insert into distributed table from file OK 2m 23s
/parquet/query/compression type/=LZ4 /insert into distributed table from file OK 2m 22s
/parquet/query/compression type/=NONE /insert into distributed table from file OK 2m 21s
/parquet/query/compression type/=GZIP /select from memory table into file OK 4m 48s
/parquet/query/compression type/=LZ4 /select from memory table into file OK 4m 49s
/parquet/query/compression type/=NONE /select from memory table into file OK 4m 50s
/parquet/chunked array XFail 12s 410ms
/parquet/broken OK 13ms
/parquet/broken/file Skip 628us
/parquet/broken/read broken bigint Skip 792us
/parquet/broken/read broken date Skip 1ms
/parquet/broken/read broken int Skip 467us
/parquet/broken/read broken smallint Skip 627us
/parquet/broken/read broken timestamp ms Skip 553us
/parquet/broken/read broken timestamp us Skip 608us
/parquet/broken/read broken tinyint Skip 561us
/parquet/broken/read broken ubigint Skip 2ms
/parquet/broken/read broken uint Skip 499us
/parquet/broken/read broken usmallint Skip 430us
/parquet/broken/read broken utinyint Skip 444us
/parquet/broken/string Skip 587us
/parquet/encoding OK 10s 94ms
/parquet/encoding/deltabytearray1 OK 1s 683ms
/parquet/encoding/deltabytearray2 OK 1s 451ms
/parquet/encoding/deltalengthbytearray OK 1s 576ms
/parquet/encoding/dictionary OK 1s 221ms
/parquet/encoding/plain OK 1s 268ms
/parquet/encoding/plainrlesnappy OK 1s 726ms
/parquet/encoding/rleboolean OK 1s 162ms
/parquet/compression OK 27s 766ms
/parquet/compression/arrow snappy OK 1s 442ms
/parquet/compression/brotli OK 1s 107ms
/parquet/compression/gzippages OK 2s 472ms
/parquet/compression/largegzip OK 1s 411ms
/parquet/compression/lz4 hadoop OK 1s 323ms
/parquet/compression/lz4 hadoop large OK 1s 74ms
/parquet/compression/lz4 non hadoop OK 1s 249ms
/parquet/compression/lz4 raw OK 1s 161ms
/parquet/compression/lz4 raw large OK 1s 550ms
/parquet/compression/lz4pages OK 2s 412ms
/parquet/compression/nonepages OK 2s 276ms
/parquet/compression/snappypages OK 2s 896ms
/parquet/compression/snappyplain OK 1s 311ms
/parquet/compression/snappyrle OK 1s 835ms
/parquet/compression/zstd OK 1s 533ms
/parquet/compression/zstdpages OK 2s 696ms
/parquet/datatypes OK 1m 41s
/parquet/datatypes/arrowtimestamp OK 2s 281ms
/parquet/datatypes/arrowtimestampms OK 1s 515ms
/parquet/datatypes/binary OK 2s 40ms
/parquet/datatypes/binary string OK 1s 610ms
/parquet/datatypes/blob OK 1s 854ms
/parquet/datatypes/boolean OK 1s 383ms
/parquet/datatypes/byte array OK 1s 367ms
/parquet/datatypes/columnname OK 1s 482ms
/parquet/datatypes/columnwithnull OK 1s 361ms
/parquet/datatypes/columnwithnull2 OK 1s 622ms
/parquet/datatypes/date OK 1s 281ms
/parquet/datatypes/decimal with filter OK 1s 406ms
/parquet/datatypes/decimalvariousfilters OK 1s 664ms
/parquet/datatypes/decimalwithfilter2 OK 1s 382ms
/parquet/datatypes/enum OK 1s 580ms
/parquet/datatypes/enum2 OK 1s 319ms
/parquet/datatypes/fixed length decimal OK 1s 267ms
/parquet/datatypes/fixed length decimal legacy OK 1s 418ms
/parquet/datatypes/fixedstring OK 1s 218ms
/parquet/datatypes/h2oai OK 1s 530ms
/parquet/datatypes/hive OK 2s 661ms
/parquet/datatypes/int32 OK 1s 335ms
/parquet/datatypes/int32 decimal OK 1s 143ms
/parquet/datatypes/int64 OK 1s 344ms
/parquet/datatypes/int64 decimal OK 1s 537ms
/parquet/datatypes/json OK 1s 324ms
/parquet/datatypes/large string map XFail 7s 731ms
/parquet/datatypes/largedouble OK 1s 143ms
/parquet/datatypes/manydatatypes OK 1s 426ms
/parquet/datatypes/manydatatypes2 OK 1s 230ms
/parquet/datatypes/maps OK 1s 259ms
/parquet/datatypes/nameswithemoji OK 1s 408ms
/parquet/datatypes/nandouble OK 1s 61ms
/parquet/datatypes/negativeint64 OK 1s 248ms
/parquet/datatypes/nullbyte OK 1s 346ms
/parquet/datatypes/nullbytemultiple OK 1s 137ms
/parquet/datatypes/nullsinid OK 1s 193ms
/parquet/datatypes/pandasdecimal OK 1s 98ms
/parquet/datatypes/pandasdecimaldate OK 1s 179ms
/parquet/datatypes/parquetgo OK 1s 182ms
/parquet/datatypes/selectdatewithfilter OK 21s 645ms
/parquet/datatypes/singlenull OK 1s 395ms
/parquet/datatypes/sparkv21 OK 1s 253ms
/parquet/datatypes/sparkv22 OK 1s 194ms
/parquet/datatypes/statdecimal OK 1s 280ms
/parquet/datatypes/string OK 1s 349ms
/parquet/datatypes/string int list inconsistent offset multiple batches Skip 6ms
/parquet/datatypes/stringtypes OK 1s 316ms
/parquet/datatypes/struct OK 1s 261ms
/parquet/datatypes/supporteduuid OK 1s 134ms
/parquet/datatypes/timestamp1 OK 1s 223ms
/parquet/datatypes/timestamp2 OK 1s 228ms
/parquet/datatypes/timezone OK 1s 213ms
/parquet/datatypes/unsigned OK 2s 463ms
/parquet/datatypes/unsupportednull OK 163ms
/parquet/complex OK 26s 448ms
/parquet/complex/arraystring OK 1s 141ms
/parquet/complex/big tuple with nulls OK 1s 443ms
/parquet/complex/bytearraydictionary OK 1s 159ms
/parquet/complex/complex null OK 1s 69ms
/parquet/complex/lagemap OK 1s 304ms
/parquet/complex/largenestedarray OK 1s 533ms
/parquet/complex/largestruct OK 1s 231ms
/parquet/complex/largestruct2 OK 1s 408ms
/parquet/complex/largestruct3 OK 1s 383ms
/parquet/complex/list OK 1s 239ms
/parquet/complex/nested array OK 1s 147ms
/parquet/complex/nested map OK 1s 180ms
/parquet/complex/nestedallcomplex OK 1s 726ms
/parquet/complex/nestedarray2 OK 1s 246ms
/parquet/complex/nestedstruct OK 1s 354ms
/parquet/complex/nestedstruct2 OK 1s 322ms
/parquet/complex/nestedstruct3 OK 1s 262ms
/parquet/complex/nestedstruct4 OK 1s 429ms
/parquet/complex/tupleofnulls OK 1s 620ms
/parquet/complex/tuplewithdatetime OK 1s 224ms
/parquet/indexing OK 1s 283ms
/parquet/indexing/bigtuplewithnulls OK 1s 281ms
/parquet/cache OK 2s 765ms
/parquet/cache/cache1 OK 1s 236ms
/parquet/cache/cache2 OK 1s 526ms
/parquet/query/compression type/=GZIP /select from mergetree table into file OK 3m 35s
/parquet/glob OK 29s 698ms
/parquet/glob/fastparquet globs OK 1s 612ms
/parquet/query/compression type/=LZ4 /select from mergetree table into file OK 3m 33s
/parquet/glob/glob1 OK 1s 88ms
/parquet/glob/glob2 OK 1s 780ms
/parquet/query/compression type/=NONE /select from mergetree table into file OK 3m 34s
/parquet/glob/glob with multiple elements OK 201ms
/parquet/glob/million extensions OK 25s 6ms
/parquet/rowgroups OK 2s 739ms
/parquet/rowgroups/manyrowgroups OK 1s 139ms
/parquet/rowgroups/manyrowgroups2 OK 1s 597ms
/parquet/encrypted Skip 718us
/parquet/fastparquet OK 31s 308ms
/parquet/fastparquet/airlines OK 1s 137ms
/parquet/fastparquet/baz OK 1s 294ms
/parquet/fastparquet/empty date OK 3s 735ms
/parquet/fastparquet/evo OK 7s 428ms
/parquet/fastparquet/fastparquet OK 17s 709ms
/parquet/query/compression type/=LZ4 /select from replicated mergetree table into file OK 3m 24s
/parquet/query/compression type/=GZIP /select from replicated mergetree table into file OK 3m 25s
/parquet/query/compression type/=NONE /select from replicated mergetree table into file OK 3m 25s
/parquet/query/compression type/=LZ4 /select from distributed table into file OK 3m 57s
/parquet/query/compression type/=GZIP /select from distributed table into file OK 3m 57s
/parquet/query/compression type/=NONE /select from distributed table into file OK 3m 56s
/parquet/query/compression type/=LZ4 /select from mat view into file OK 3m 8s
/parquet/query/compression type/=GZIP /select from mat view into file OK 3m 7s
/parquet/query/compression type/=NONE /select from mat view into file OK 3m 7s
/parquet/query/compression type/=NONE /insert into table with projection from file OK 49s 617ms
/parquet/query/compression type/=GZIP /insert into table with projection from file OK 49s 456ms
/parquet/query/compression type/=LZ4 /insert into table with projection from file OK 49s 320ms

Generated by TestFlows Open-Source Test Framework v2.0.231130.1212236