Parquet Test Run Report

DateMar 01, 2024 21:26
Duration34m 50s
Framework TestFlows 2.0.231215.1221232

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/false/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
version23.3.19.33.altinitystable
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6da94b78dc53cb8965ab56c04a89ebf54ed04cbc
job.id8115174679
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/8115174679
archx86_64
nodeclickhouse1
allow_vfsFalse
localTrue
clickhouse_versionNone
clickhouse_binary_pathhttps://s3.amazonaws.com/altinity-build-artifacts/23.3/19a57e6f4a8ca8dd7737ac12f3ba472b37ac166c/package_release/clickhouse-common-static_23.3.19.33.altinitystable_amd64.deb
stressFalse
collect_service_logsTrue
storagesNone
minio_urihttp://minio1:9001
minio_root_userminio
minio_root_passwordminio123
aws_s3_bucketNone
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

100%OK
<1%Known

Statistics

Units Skip OK Fail XFail
Modules
1
1
Suites
2
2
Features
38
1
36
1
Scenarios
216
2
213
1
Checks
59679
59679
Examples
12
12
Steps
380252
377570
4
2678

Known Fails

Test NameResultMessage
/parquet/chunked arrayXFail 11s 731ms
Not supported
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/chunked_array.py", line 30, in feature
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 844, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Error on processing query: Code: 33. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File: data for INSERT was parsed from file. (CANNOT_READ_ALL_DATA) (version 23.3.19.33.altinitystable (altinity build))
(query: INSERT INTO table_d8240619_d814_11ee_b16d_07d00e3b5ba7 FROM INFILE '/var/lib/clickhouse/user_files/chunked_array_test_file.parquet' FORMAT Parquet)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 844 in 'query'

836\|                  assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
840\|                  with Then("check if output has exception") if steps else NullStep():
841\|                      if "Exception:" in r.output:
842\|                          if raise_on_exception:
843\|                              raise QueryRuntimeException(r.output)
844\|>                         assert False, error(r.output)
845\|  
846\|          return r
847\|
/parquet/datatypes/large string mapXFail 9s 201ms
Will fail until the, https://github.com/apache/arrow/pull/35825, gets merged.
AssertionError
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 877, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/datatypes.py", line 762, in large_string_map
    import_export(snapshot_name="large_string_map_structure", import_file=import_file)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../parquet/tests/outline.py", line 49, in import_export
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py", line 844, in query
    assert False, error(r.output)
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 23.3.19):
Code: 33. DB::Exception: Received from localhost:9000. DB::ParsingException. DB::ParsingException: Error while reading Parquet data: NotImplemented: Nested data conversions not implemented for chunked array outputs: While executing ParquetBlockInputFormat: While executing File. (CANNOT_READ_ALL_DATA)
(query: CREATE TABLE table_07280c9c_d815_11ee_b16d_07d00e3b5ba7
            ENGINE = MergeTree
            ORDER BY tuple() AS SELECT * FROM file('arrow/large_string_map.brotli.parquet', Parquet) LIMIT 100
            )

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/parquet/../helpers/cluster.py', line 844 in 'query'

836\|                  assert message in r.output, error(r.output)
837\|  
838\|          if not ignore_exception:
839\|              if message is None or "Exception:" not in message:
840\|                  with Then("check if output has exception") if steps else NullStep():
841\|                      if "Exception:" in r.output:
842\|                          if raise_on_exception:
843\|                              raise QueryRuntimeException(r.output)
844\|>                         assert False, error(r.output)
845\|  
846\|          return r
847\|

Results

Test Name Result Duration
/parquet OK 34m 50s
/parquet/file OK 24m 42s
/parquet/file/engine OK 24m 42s
/parquet/file/function OK 13m 5s
/parquet/file/engine/insert into engine OK 14m 50s
/parquet/query OK 32m 34s
/parquet/query/compression type OK 32m 34s
/parquet/file/function/insert into function manual cast types OK 12m 20s
/parquet/file/function/insert into function auto cast types OK 13m 5s
/parquet/file/engine/select from engine OK 6m 56s
/parquet/file/function/select from function manual cast types OK 7m 22s
/parquet/query/compression type/=NONE OK 32m 28s
/parquet/query/compression type/=NONE /insert into memory table from file OK 6m 48s
/parquet/file/engine/engine to file to engine OK 18m 43s
/parquet/file/function/select from function auto cast types OK 6m 49s
/parquet/list in multiple chunks OK 18s 289ms
/parquet/query/compression type/=GZIP OK 32m 34s
/parquet/file/engine/insert into engine from file OK 13m 32s
/parquet/file/engine/engine select output to file OK 24m 42s
/parquet/query/compression type/=LZ4 OK 32m 33s
/parquet/url OK 25m 59s
/parquet/query/compression type/=GZIP /insert into memory table from file OK 6m 48s
/parquet/query/compression type/=LZ4 /insert into memory table from file OK 6m 50s
/parquet/url/engine OK 25m 20s
/parquet/url/engine/insert into engine OK 15m 40s
/parquet/url/function OK 12m 20s
/parquet/url/engine/select from engine OK 7m 3s
/parquet/url/function/insert into function OK 12m 20s
/parquet/url/engine/engine to file to engine OK 19m 12s
/parquet/url/function/select from function manual cast types OK 11m 51s
/parquet/url/engine/insert into engine from file OK 18m 3s
/parquet/url/function/select from function auto cast types OK 11m 15s
/parquet/url/engine/engine select output to file OK 25m 20s
/parquet/mysql OK 34s 234ms
/parquet/mysql/compression type OK 34s 213ms
/parquet/mysql/compression type/=NONE OK 33s 478ms
/parquet/mysql/compression type/=NONE /mysql engine to parquet file to mysql engine OK 20s 709ms
/parquet/mysql/compression type/=LZ4 OK 33s 528ms
/parquet/mysql/compression type/=LZ4 /mysql engine to parquet file to mysql engine OK 20s 330ms
/parquet/mysql/compression type/=GZIP OK 34s 177ms
/parquet/mysql/compression type/=GZIP /mysql engine to parquet file to mysql engine OK 20s 267ms
/parquet/mysql/compression type/=LZ4 /mysql function to parquet file to mysql function OK 13s 69ms
/parquet/mysql/compression type/=GZIP /mysql function to parquet file to mysql function OK 13s 684ms
/parquet/mysql/compression type/=NONE /mysql function to parquet file to mysql function OK 12s 647ms
/parquet/postgresql OK 38s 16ms
/parquet/postgresql/compression type OK 37s 909ms
/parquet/postgresql/compression type/=NONE OK 36s 155ms
/parquet/postgresql/compression type/=GZIP OK 35s 677ms
/parquet/postgresql/compression type/=LZ4 OK 37s 851ms
/parquet/postgresql/compression type/=NONE /postgresql engine to parquet file to postgresql engine OK 21s 343ms
/parquet/postgresql/compression type/=GZIP /postgresql engine to parquet file to postgresql engine OK 20s 912ms
/parquet/postgresql/compression type/=LZ4 /postgresql engine to parquet file to postgresql engine OK 23s 42ms
/parquet/postgresql/compression type/=GZIP /postgresql function to parquet file to postgresql function OK 14s 449ms
/parquet/postgresql/compression type/=NONE /postgresql function to parquet file to postgresql function OK 14s 706ms
/parquet/postgresql/compression type/=LZ4 /postgresql function to parquet file to postgresql function OK 14s 695ms
/parquet/remote OK 15m 19s
/parquet/remote/compression type OK 15m 19s
/parquet/remote/compression type/=NONE OK 15m 17s
/parquet/remote/compression type/=GZIP OK 15m 19s
/parquet/remote/compression type/=LZ4 OK 15m 15s
/parquet/remote/compression type/=NONE /outline OK 15m 17s
/parquet/remote/compression type/=GZIP /outline OK 15m 19s
/parquet/remote/compression type/=LZ4 /outline OK 15m 15s
/parquet/remote/compression type/=NONE /outline/insert into function OK 7m 12s
/parquet/remote/compression type/=GZIP /outline/insert into function OK 7m 12s
/parquet/remote/compression type/=LZ4 /outline/insert into function OK 7m 12s
/parquet/query/compression type/=NONE /insert into mergetree table from file OK 4m 7s
/parquet/query/compression type/=GZIP /insert into mergetree table from file OK 4m 6s
/parquet/query/compression type/=LZ4 /insert into mergetree table from file OK 4m 6s
/parquet/remote/compression type/=LZ4 /outline/select from function OK 8m 3s
/parquet/remote/compression type/=NONE /outline/select from function OK 8m 5s
/parquet/remote/compression type/=GZIP /outline/select from function OK 8m 6s
/parquet/query/compression type/=GZIP /insert into replicated mergetree table from file OK 2m 35s
/parquet/query/compression type/=NONE /insert into replicated mergetree table from file OK 2m 34s
/parquet/query/compression type/=LZ4 /insert into replicated mergetree table from file OK 2m 35s
/parquet/query/compression type/=NONE /insert into distributed table from file OK 1m 51s
/parquet/query/compression type/=GZIP /insert into distributed table from file OK 1m 51s
/parquet/query/compression type/=LZ4 /insert into distributed table from file OK 1m 50s
/parquet/query/compression type/=NONE /select from memory table into file OK 4m 6s
/parquet/query/compression type/=GZIP /select from memory table into file OK 4m 6s
/parquet/query/compression type/=LZ4 /select from memory table into file OK 4m 6s
/parquet/chunked array XFail 11s 731ms
/parquet/broken OK 3s 616ms
/parquet/broken/file OK 159ms
/parquet/broken/read broken bigint OK 134ms
/parquet/broken/read broken date OK 175ms
/parquet/broken/read broken int OK 166ms
/parquet/broken/read broken smallint OK 241ms
/parquet/broken/read broken timestamp ms OK 174ms
/parquet/broken/read broken timestamp us OK 163ms
/parquet/broken/read broken tinyint OK 102ms
/parquet/broken/read broken ubigint OK 110ms
/parquet/broken/read broken uint OK 168ms
/parquet/broken/read broken usmallint OK 150ms
/parquet/broken/read broken utinyint OK 160ms
/parquet/broken/string OK 1s 672ms
/parquet/encoding OK 8s 488ms
/parquet/encoding/deltabytearray1 OK 1s 183ms
/parquet/encoding/deltabytearray2 OK 1s 189ms
/parquet/encoding/deltalengthbytearray OK 1s 29ms
/parquet/encoding/dictionary OK 1s 166ms
/parquet/encoding/plain OK 1s 249ms
/parquet/encoding/plainrlesnappy OK 1s 416ms
/parquet/encoding/rleboolean OK 1s 245ms
/parquet/compression OK 24s 201ms
/parquet/compression/arrow snappy OK 1s 40ms
/parquet/compression/brotli OK 1s 170ms
/parquet/compression/gzippages OK 2s 189ms
/parquet/compression/largegzip OK 1s 275ms
/parquet/compression/lz4 hadoop OK 1s 99ms
/parquet/compression/lz4 hadoop large OK 1s 121ms
/parquet/compression/lz4 non hadoop OK 1s 141ms
/parquet/compression/lz4 raw OK 989ms
/parquet/compression/lz4 raw large OK 1s 13ms
/parquet/compression/lz4pages OK 2s 386ms
/parquet/compression/nonepages OK 2s 527ms
/parquet/compression/snappypages OK 2s 422ms
/parquet/compression/snappyplain OK 1s 151ms
/parquet/compression/snappyrle OK 1s 200ms
/parquet/compression/zstd OK 1s 211ms
/parquet/compression/zstdpages OK 2s 242ms
/parquet/datatypes OK 1m 20s
/parquet/datatypes/arrowtimestamp OK 1s 233ms
/parquet/datatypes/arrowtimestampms OK 1s 200ms
/parquet/datatypes/binary OK 1s 220ms
/parquet/datatypes/binary string OK 1s 100ms
/parquet/datatypes/blob OK 1s 42ms
/parquet/datatypes/boolean OK 1s 341ms
/parquet/datatypes/byte array OK 1s 112ms
/parquet/datatypes/columnname OK 1s 53ms
/parquet/datatypes/columnwithnull OK 1s 284ms
/parquet/datatypes/columnwithnull2 OK 1s 221ms
/parquet/datatypes/date OK 1s 321ms
/parquet/datatypes/decimal with filter OK 1s 351ms
/parquet/datatypes/decimalvariousfilters OK 1s 87ms
/parquet/datatypes/decimalwithfilter2 OK 1s 303ms
/parquet/datatypes/enum OK 951ms
/parquet/datatypes/enum2 OK 1s 0ms
/parquet/datatypes/fixed length decimal OK 1s 220ms
/parquet/datatypes/fixed length decimal legacy OK 1s 171ms
/parquet/datatypes/fixedstring OK 1s 128ms
/parquet/datatypes/h2oai OK 1s 308ms
/parquet/datatypes/hive OK 2s 109ms
/parquet/datatypes/int32 OK 1s 175ms
/parquet/datatypes/int32 decimal OK 1s 190ms
/parquet/datatypes/int64 OK 1s 168ms
/parquet/datatypes/int64 decimal OK 1s 183ms
/parquet/datatypes/json OK 1s 184ms
/parquet/datatypes/large string map XFail 9s 201ms
/parquet/datatypes/largedouble OK 1s 21ms
/parquet/datatypes/manydatatypes OK 910ms
/parquet/datatypes/manydatatypes2 OK 1s 393ms
/parquet/datatypes/maps OK 920ms
/parquet/datatypes/nameswithemoji OK 986ms
/parquet/datatypes/nandouble OK 1s 25ms
/parquet/datatypes/negativeint64 OK 1s 259ms
/parquet/datatypes/nullbyte OK 1s 3ms
/parquet/datatypes/nullbytemultiple OK 964ms
/parquet/datatypes/nullsinid OK 1s 59ms
/parquet/datatypes/pandasdecimal OK 1s 7ms
/parquet/datatypes/pandasdecimaldate OK 953ms
/parquet/datatypes/parquetgo OK 1s 36ms
/parquet/datatypes/selectdatewithfilter OK 13s 341ms
/parquet/datatypes/singlenull OK 933ms
/parquet/datatypes/sparkv21 OK 868ms
/parquet/datatypes/sparkv22 OK 1s 105ms
/parquet/datatypes/statdecimal OK 832ms
/parquet/datatypes/string OK 882ms
/parquet/datatypes/string int list inconsistent offset multiple batches Skip 906us
/parquet/datatypes/stringtypes OK 934ms
/parquet/datatypes/struct OK 889ms
/parquet/datatypes/supporteduuid OK 1s 150ms
/parquet/datatypes/timestamp1 OK 871ms
/parquet/datatypes/timestamp2 OK 870ms
/parquet/datatypes/timezone OK 880ms
/parquet/datatypes/unsigned OK 1s 879ms
/parquet/datatypes/unsupportednull OK 178ms
/parquet/complex OK 18s 892ms
/parquet/complex/arraystring OK 860ms
/parquet/complex/big tuple with nulls OK 916ms
/parquet/complex/bytearraydictionary OK 1s 165ms
/parquet/complex/complex null OK 848ms
/parquet/complex/lagemap OK 866ms
/parquet/complex/largenestedarray OK 810ms
/parquet/complex/largestruct OK 938ms
/parquet/complex/largestruct2 OK 1s 91ms
/parquet/complex/largestruct3 OK 873ms
/parquet/complex/list OK 893ms
/parquet/complex/nested array OK 830ms
/parquet/complex/nested map OK 1s 103ms
/parquet/complex/nestedallcomplex OK 989ms
/parquet/complex/nestedarray2 OK 818ms
/parquet/complex/nestedstruct OK 1s 26ms
/parquet/complex/nestedstruct2 OK 985ms
/parquet/complex/nestedstruct3 OK 1s 71ms
/parquet/complex/nestedstruct4 OK 1s 34ms
/parquet/complex/tupleofnulls OK 915ms
/parquet/complex/tuplewithdatetime OK 839ms
/parquet/indexing OK 853ms
/parquet/indexing/bigtuplewithnulls OK 851ms
/parquet/cache OK 1s 932ms
/parquet/cache/cache1 OK 1s 93ms
/parquet/cache/cache2 OK 837ms
/parquet/glob OK 20s 352ms
/parquet/glob/fastparquet globs OK 847ms
/parquet/glob/glob1 OK 953ms
/parquet/glob/glob2 OK 1s 116ms
/parquet/glob/glob with multiple elements Skip 519us
/parquet/glob/million extensions OK 17s 431ms
/parquet/query/compression type/=NONE /select from mergetree table into file OK 3m 17s
/parquet/query/compression type/=GZIP /select from mergetree table into file OK 3m 19s
/parquet/query/compression type/=LZ4 /select from mergetree table into file OK 3m 19s
/parquet/rowgroups OK 1s 494ms
/parquet/rowgroups/manyrowgroups OK 780ms
/parquet/rowgroups/manyrowgroups2 OK 713ms
/parquet/encrypted Skip 573us
/parquet/fastparquet OK 21s 525ms
/parquet/fastparquet/airlines OK 899ms
/parquet/fastparquet/baz OK 721ms
/parquet/fastparquet/empty date OK 2s 197ms
/parquet/fastparquet/evo OK 4s 621ms
/parquet/fastparquet/fastparquet OK 13s 83ms
/parquet/read and write OK 9m 31s
/parquet/read and write/read and write parquet file OK 9m 31s
/parquet/query/compression type/=NONE /select from replicated mergetree table into file OK 3m 17s
/parquet/query/compression type/=LZ4 /select from replicated mergetree table into file OK 3m 17s
/parquet/query/compression type/=GZIP /select from replicated mergetree table into file OK 3m 17s
/parquet/query/compression type/=NONE /select from distributed table into file OK 3m 19s
/parquet/query/compression type/=LZ4 /select from distributed table into file OK 3m 19s
/parquet/query/compression type/=GZIP /select from distributed table into file OK 3m 20s
/parquet/query/compression type/=NONE /select from mat view into file OK 2m 34s
/parquet/query/compression type/=LZ4 /select from mat view into file OK 2m 36s
/parquet/query/compression type/=GZIP /select from mat view into file OK 2m 38s
/parquet/query/compression type/=NONE /insert into table with projection from file OK 31s 235ms
/parquet/query/compression type/=LZ4 /insert into table with projection from file OK 31s 78ms
/parquet/query/compression type/=GZIP /insert into table with projection from file OK 29s 123ms

Generated by TestFlows Open-Source Test Framework v2.0.231215.1221232