Parquet Test Run Report

DateApr 28, 2024 17:08
Duration1h 1m
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_aarch64/clickhouse-common-static_23.8.11.29.altinitystable_arm64.deb
version23.8.11.29.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash17a81c07fc1f41fbee651e0ef0ca4b44e537e5b1
job.id8868426423
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8868426423
archaarch64
nodeclickhouse1
allow_vfsFalse
allow_experimental_analyzerFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.8/8e9be16153250c8307730c9b88c8517181f494ce/package_aarch64/clickhouse-common-static_23.8.11.29.altinitystable_arm64.deb
stressFalse
collect_service_logsTrue
storagesNone
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

100%OK
<1%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
2
2
Features
38
1
36
1
Scenarios
216
14
201
1
Checks
59678
59678
Examples
12
12
Steps
380173
377995
4
2174

Known Fails

Test NameResultMessage
/parquet/chunked arrayXFail 15s 293ms
Not supported
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/chunked_array.py", line 30, in feature
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 844, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Error on processing query: Code: 33. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File: data for INSERT was parsed from file. (CANNOT_READ_ALL_DATA) (version 23.8.11.29.altinitystable (altinity build))
(query: INSERT INTO table_dafc26cf_0585_11ef_82b8_5716c4386058 FROM INFILE '/var/lib/clickhouse/user_files/chunked_array_test_file.parquet' FORMAT Parquet)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 844 in 'query'

836\|                  assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
840\|                  with Then("check if output has exception") if steps else NullStep():
841\|                      if "Exception:" in r.output:
842\|                          if raise_on_exception:
843\|                              raise QueryRuntimeException(r.output)
844\|>                         assert False, error(r.output)
845\|  
846\|          return r
847\|
/parquet/datatypes/large string mapXFail 6s 923ms
Will fail until the, https://github.com/apache/arrow/pull/35825, gets merged.
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 884, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 762, in large_string_map
    import_export(snapshot_name="large_string_map_structure", import_file=import_file)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/outline.py", line 34, in import_export
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 844, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 23.8.11):
Code: 33. DB::Exception: Received from localhost:9000. DB::ParsingException. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File. (CANNOT_READ_ALL_DATA)
(query: CREATE TABLE table_b3ce57c0_0586_11ef_82b8_5716c4386058
            ENGINE = MergeTree
            ORDER BY tuple() AS SELECT * FROM file('arrow/large_string_map.brotli.parquet', Parquet) LIMIT 100
            )

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 844 in 'query'

836\|                  assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
840\|                  with Then("check if output has exception") if steps else NullStep():
841\|                      if "Exception:" in r.output:
842\|                          if raise_on_exception:
843\|                              raise QueryRuntimeException(r.output)
844\|>                         assert False, error(r.output)
845\|  
846\|          return r
847\|

Results

Test Name Result Duration
/parquet OK 1h 1m
/parquet/file OK 54m 21s
/parquet/file/engine OK 54m 21s
/parquet/file/function OK 24m 14s
/parquet/file/engine/insert into engine OK 22m 47s
/parquet/file/function/insert into function manual cast types OK 18m 28s
/parquet/file/engine/select from engine OK 9m 37s
/parquet/file/function/insert into function auto cast types OK 24m 14s
/parquet/file/function/select from function manual cast types OK 14m 23s
/parquet/file/engine/engine to file to engine OK 32m 4s
/parquet/file/engine/insert into engine from file OK 20m 34s
/parquet/file/engine/engine select output to file OK 54m 21s
/parquet/file/function/select from function auto cast types OK 9m 27s
/parquet/query OK 53m 52s
/parquet/query/compression type OK 53m 52s
/parquet/list in multiple chunks OK 52s 738ms
/parquet/url OK 55m 30s
/parquet/query/compression type/=NONE OK 53m 51s
/parquet/query/compression type/=LZ4 OK 53m 51s
/parquet/query/compression type/=GZIP OK 53m 52s
/parquet/query/compression type/=NONE /insert into memory table from file OK 9m 25s
/parquet/query/compression type/=LZ4 /insert into memory table from file OK 9m 21s
/parquet/query/compression type/=GZIP /insert into memory table from file OK 9m 23s
/parquet/url/engine OK 54m 41s
/parquet/url/engine/insert into engine OK 27m 20s
/parquet/url/engine/select from engine OK 9m 33s
/parquet/url/function OK 28m 53s
/parquet/url/engine/engine to file to engine OK 32m 11s
/parquet/url/function/insert into function OK 18m 15s
/parquet/url/function/select from function manual cast types OK 28m 53s
/parquet/url/engine/insert into engine from file OK 29m 9s
/parquet/url/function/select from function auto cast types OK 16m 27s
/parquet/url/engine/engine select output to file OK 54m 41s
/parquet/mysql OK 1m 39s
/parquet/mysql/compression type OK 1m 39s
/parquet/mysql/compression type/=NONE OK 1m 37s
/parquet/mysql/compression type/=GZIP OK 1m 37s
/parquet/mysql/compression type/=LZ4 OK 1m 38s
/parquet/mysql/compression type/=GZIP /mysql engine to parquet file to mysql engine OK 1m 7s
/parquet/mysql/compression type/=NONE /mysql engine to parquet file to mysql engine OK 1m 8s
/parquet/mysql/compression type/=LZ4 /mysql engine to parquet file to mysql engine OK 1m 9s
/parquet/mysql/compression type/=GZIP /mysql function to parquet file to mysql function OK 29s 970ms
/parquet/mysql/compression type/=NONE /mysql function to parquet file to mysql function OK 29s 120ms
/parquet/mysql/compression type/=LZ4 /mysql function to parquet file to mysql function OK 29s 646ms
/parquet/postgresql OK 1m 23s
/parquet/postgresql/compression type OK 1m 22s
/parquet/postgresql/compression type/=GZIP OK 1m 22s
/parquet/postgresql/compression type/=NONE OK 1m 20s
/parquet/postgresql/compression type/=LZ4 OK 1m 21s
/parquet/postgresql/compression type/=GZIP /postgresql engine to parquet file to postgresql engine OK 50s 424ms
/parquet/postgresql/compression type/=LZ4 /postgresql engine to parquet file to postgresql engine OK 49s 346ms
/parquet/postgresql/compression type/=NONE /postgresql engine to parquet file to postgresql engine OK 48s 553ms
/parquet/postgresql/compression type/=NONE /postgresql function to parquet file to postgresql function OK 31s 481ms
/parquet/postgresql/compression type/=LZ4 /postgresql function to parquet file to postgresql function OK 31s 554ms
/parquet/postgresql/compression type/=GZIP /postgresql function to parquet file to postgresql function OK 32s 340ms
/parquet/remote OK 22m 47s
/parquet/remote/compression type OK 22m 47s
/parquet/remote/compression type/=NONE OK 22m 47s
/parquet/remote/compression type/=GZIP OK 22m 41s
/parquet/remote/compression type/=LZ4 OK 22m 47s
/parquet/remote/compression type/=LZ4 /outline OK 22m 47s
/parquet/remote/compression type/=GZIP /outline OK 22m 41s
/parquet/remote/compression type/=LZ4 /outline/insert into function OK 7m 30s
/parquet/remote/compression type/=GZIP /outline/insert into function OK 7m 25s
/parquet/remote/compression type/=NONE /outline OK 22m 47s
/parquet/remote/compression type/=NONE /outline/insert into function OK 7m 32s
/parquet/query/compression type/=LZ4 /insert into mergetree table from file OK 6m 2s
/parquet/query/compression type/=GZIP /insert into mergetree table from file OK 6m 2s
/parquet/query/compression type/=NONE /insert into mergetree table from file OK 6m 0s
/parquet/remote/compression type/=GZIP /outline/select from function OK 15m 15s
/parquet/remote/compression type/=LZ4 /outline/select from function OK 15m 16s
/parquet/remote/compression type/=NONE /outline/select from function OK 15m 14s
/parquet/query/compression type/=LZ4 /insert into replicated mergetree table from file OK 4m 50s
/parquet/query/compression type/=GZIP /insert into replicated mergetree table from file OK 4m 50s
/parquet/query/compression type/=NONE /insert into replicated mergetree table from file OK 4m 50s
/parquet/query/compression type/=LZ4 /insert into distributed table from file OK 3m 50s
/parquet/query/compression type/=GZIP /insert into distributed table from file OK 3m 51s
/parquet/query/compression type/=NONE /insert into distributed table from file OK 3m 50s
/parquet/query/compression type/=LZ4 /select from memory table into file OK 7m 12s
/parquet/query/compression type/=NONE /select from memory table into file OK 7m 8s
/parquet/query/compression type/=GZIP /select from memory table into file OK 7m 8s
/parquet/chunked array XFail 15s 293ms
/parquet/broken OK 35ms
/parquet/broken/file Skip 1ms
/parquet/broken/read broken bigint Skip 855us
/parquet/broken/read broken date Skip 8ms
/parquet/broken/read broken int Skip 791us
/parquet/broken/read broken smallint Skip 707us
/parquet/broken/read broken timestamp ms Skip 687us
/parquet/broken/read broken timestamp us Skip 6ms
/parquet/broken/read broken tinyint Skip 1ms
/parquet/broken/read broken ubigint Skip 1ms
/parquet/broken/read broken uint Skip 832us
/parquet/broken/read broken usmallint Skip 4ms
/parquet/broken/read broken utinyint Skip 968us
/parquet/broken/string Skip 944us
/parquet/encoding OK 51s 238ms
/parquet/encoding/deltabytearray1 OK 7s 124ms
/parquet/encoding/deltabytearray2 OK 6s 614ms
/parquet/encoding/deltalengthbytearray OK 6s 781ms
/parquet/encoding/dictionary OK 6s 700ms
/parquet/encoding/plain OK 8s 275ms
/parquet/encoding/plainrlesnappy OK 6s 671ms
/parquet/encoding/rleboolean OK 9s 59ms
/parquet/compression OK 2m 14s
/parquet/compression/arrow snappy OK 9s 611ms
/parquet/compression/brotli OK 6s 212ms
/parquet/compression/gzippages OK 13s 261ms
/parquet/compression/largegzip OK 6s 396ms
/parquet/compression/lz4 hadoop OK 6s 358ms
/parquet/compression/lz4 hadoop large OK 6s 315ms
/parquet/compression/lz4 non hadoop OK 6s 111ms
/parquet/compression/lz4 raw OK 7s 312ms
/parquet/compression/lz4 raw large OK 6s 624ms
/parquet/compression/lz4pages OK 12s 812ms
/parquet/compression/nonepages OK 12s 328ms
/parquet/compression/snappypages OK 11s 672ms
/parquet/compression/snappyplain OK 5s 850ms
/parquet/compression/snappyrle OK 5s 832ms
/parquet/compression/zstd OK 5s 994ms
/parquet/compression/zstdpages OK 11s 896ms
/parquet/datatypes OK 5m 28s
/parquet/datatypes/arrowtimestamp OK 6s 171ms
/parquet/datatypes/arrowtimestampms OK 6s 126ms
/parquet/datatypes/binary OK 6s 214ms
/parquet/datatypes/binary string OK 5s 830ms
/parquet/datatypes/blob OK 5s 793ms
/parquet/datatypes/boolean OK 5s 751ms
/parquet/datatypes/byte array OK 5s 899ms
/parquet/datatypes/columnname OK 6s 373ms
/parquet/datatypes/columnwithnull OK 6s 373ms
/parquet/datatypes/columnwithnull2 OK 5s 755ms
/parquet/datatypes/date OK 5s 854ms
/parquet/datatypes/decimal with filter OK 6s 31ms
/parquet/query/compression type/=GZIP /select from mergetree table into file OK 5m 19s
/parquet/query/compression type/=NONE /select from mergetree table into file OK 5m 18s
/parquet/datatypes/decimalvariousfilters OK 5s 574ms
/parquet/query/compression type/=LZ4 /select from mergetree table into file OK 5m 16s
/parquet/datatypes/decimalwithfilter2 OK 9s 735ms
/parquet/datatypes/enum OK 8s 730ms
/parquet/datatypes/enum2 OK 6s 159ms
/parquet/datatypes/fixed length decimal OK 5s 822ms
/parquet/datatypes/fixed length decimal legacy OK 5s 729ms
/parquet/datatypes/fixedstring OK 6s 97ms
/parquet/datatypes/h2oai OK 5s 478ms
/parquet/datatypes/hive OK 11s 306ms
/parquet/datatypes/int32 OK 5s 577ms
/parquet/datatypes/int32 decimal OK 5s 505ms
/parquet/datatypes/int64 OK 5s 207ms
/parquet/datatypes/int64 decimal OK 5s 388ms
/parquet/datatypes/json OK 5s 518ms
/parquet/datatypes/large string map XFail 6s 923ms
/parquet/datatypes/largedouble OK 5s 458ms
/parquet/datatypes/manydatatypes OK 5s 546ms
/parquet/datatypes/manydatatypes2 OK 5s 717ms
/parquet/datatypes/maps OK 5s 804ms
/parquet/datatypes/nameswithemoji OK 5s 430ms
/parquet/datatypes/nandouble OK 5s 427ms
/parquet/datatypes/negativeint64 OK 5s 370ms
/parquet/datatypes/nullbyte OK 5s 461ms
/parquet/datatypes/nullbytemultiple OK 5s 620ms
/parquet/datatypes/nullsinid OK 5s 554ms
/parquet/datatypes/pandasdecimal OK 5s 461ms
/parquet/datatypes/pandasdecimaldate OK 5s 358ms
/parquet/datatypes/parquetgo OK 5s 408ms
/parquet/datatypes/selectdatewithfilter OK 13s 395ms
/parquet/datatypes/singlenull OK 5s 542ms
/parquet/datatypes/sparkv21 OK 5s 462ms
/parquet/datatypes/sparkv22 OK 5s 527ms
/parquet/datatypes/statdecimal OK 5s 456ms
/parquet/datatypes/string OK 5s 407ms
/parquet/datatypes/string int list inconsistent offset multiple batches Skip 1ms
/parquet/datatypes/stringtypes OK 5s 617ms
/parquet/datatypes/struct OK 5s 453ms
/parquet/datatypes/supporteduuid OK 5s 431ms
/parquet/datatypes/timestamp1 OK 5s 438ms
/parquet/datatypes/timestamp2 OK 5s 660ms
/parquet/datatypes/timezone OK 5s 466ms
/parquet/datatypes/unsigned OK 11s 365ms
/parquet/datatypes/unsupportednull OK 281ms
/parquet/complex OK 1m 57s
/parquet/complex/arraystring OK 5s 427ms
/parquet/complex/big tuple with nulls OK 5s 550ms
/parquet/complex/bytearraydictionary OK 5s 559ms
/parquet/complex/complex null OK 5s 613ms
/parquet/complex/lagemap OK 5s 496ms
/parquet/complex/largenestedarray OK 5s 460ms
/parquet/complex/largestruct OK 5s 537ms
/parquet/complex/largestruct2 OK 5s 953ms
/parquet/complex/largestruct3 OK 5s 448ms
/parquet/complex/list OK 5s 524ms
/parquet/complex/nested array OK 5s 458ms
/parquet/complex/nested map OK 5s 688ms
/parquet/query/compression type/=LZ4 /select from replicated mergetree table into file OK 5m 10s
/parquet/query/compression type/=NONE /select from replicated mergetree table into file OK 5m 10s
/parquet/query/compression type/=GZIP /select from replicated mergetree table into file OK 5m 8s
/parquet/complex/nestedallcomplex OK 10s 501ms
/parquet/complex/nestedarray2 OK 6s 845ms
/parquet/complex/nestedstruct OK 5s 640ms
/parquet/complex/nestedstruct2 OK 5s 416ms
/parquet/complex/nestedstruct3 OK 5s 476ms
/parquet/complex/nestedstruct4 OK 5s 586ms
/parquet/complex/tupleofnulls OK 5s 506ms
/parquet/complex/tuplewithdatetime OK 5s 551ms
/parquet/indexing OK 5s 334ms
/parquet/indexing/bigtuplewithnulls OK 5s 333ms
/parquet/cache OK 11s 100ms
/parquet/cache/cache1 OK 5s 537ms
/parquet/cache/cache2 OK 5s 561ms
/parquet/glob OK 33s 142ms
/parquet/glob/fastparquet globs OK 1s 501ms
/parquet/glob/glob1 OK 1s 485ms
/parquet/glob/glob2 OK 1s 682ms
/parquet/glob/glob with multiple elements OK 339ms
/parquet/glob/million extensions OK 28s 123ms
/parquet/rowgroups OK 10s 767ms
/parquet/rowgroups/manyrowgroups OK 5s 491ms
/parquet/rowgroups/manyrowgroups2 OK 5s 273ms
/parquet/encrypted Skip 940us
/parquet/fastparquet OK 2m 33s
/parquet/fastparquet/airlines OK 5s 527ms
/parquet/fastparquet/baz OK 5s 313ms
/parquet/fastparquet/empty date OK 16s 792ms
/parquet/fastparquet/evo OK 33s 308ms
/parquet/fastparquet/fastparquet OK 1m 32s
/parquet/read and write OK 17m 47s
/parquet/read and write/read and write parquet file OK 17m 47s
/parquet/query/compression type/=GZIP /select from distributed table into file OK 5m 44s
/parquet/query/compression type/=LZ4 /select from distributed table into file OK 5m 46s
/parquet/query/compression type/=NONE /select from distributed table into file OK 5m 43s
/parquet/query/compression type/=GZIP /select from mat view into file OK 4m 47s
/parquet/query/compression type/=NONE /select from mat view into file OK 4m 46s
/parquet/query/compression type/=LZ4 /select from mat view into file OK 4m 43s
/parquet/query/compression type/=LZ4 /insert into table with projection from file OK 1m 37s
/parquet/query/compression type/=NONE /insert into table with projection from file OK 1m 37s
/parquet/query/compression type/=GZIP /insert into table with projection from file OK 1m 36s

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232