Implementation status

This page summarizes the features supported by different Parquet implementations.

Note: If you find out of date information, please help us improve the accuracy of this page by opening an issue or submitting a pull request.

The value in each box means:

Physical types are defined by the enum Type in parquet.thrift

Data Type	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
BOOLEAN	✅	✅	✅	✅	✅	✅	✅
INT32	✅	✅	✅	✅	✅	✅	✅
INT64	✅	✅	✅	✅	✅	✅	✅
INT96¹	✅	✅	✅	✅	✅	(R)	(R)
FLOAT	✅	✅	✅	✅	✅	✅	✅
DOUBLE	✅	✅	✅	✅	✅	✅	✅
BYTE_ARRAY	✅	✅	✅	✅	✅	✅	✅
FIXED_LEN_BYTE_ARRAY	✅	✅	✅	✅	✅	✅	✅

Notes:

(1) This type is deprecated, but as of 2024 it's common in currently produced parquet files

Data Type	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
STRING	✅	✅	✅	✅	✅	✅	✅
ENUM	❌	✅	✅	✅(1)	❌	✅	✅
UUID	❌	✅	✅	✅(1)	❌	✅	✅
8, 16, 32, 64 bit signed and unsigned INT	✅	✅	✅	✅	✅	✅	✅
DECIMAL (INT32)	✅	✅	✅	✅	✅	✅	✅
DECIMAL (INT64)	✅	✅	✅	✅	✅	✅	✅
DECIMAL (BYTE_ARRAY)	✅	✅	✅	✅	✅	✅	(R)
DECIMAL (FIXED_LEN_BYTE_ARRAY)	✅	✅	✅	✅	✅	✅	✅
FLOAT16	✅	✅(1)	✅	✅	✅	✅	✅
DATE	✅	✅	✅	✅	✅	✅	✅
TIME (INT32)	✅	✅	✅	✅	✅	✅	✅
TIME (INT64)	✅	✅	✅	✅	✅	✅	✅
TIMESTAMP (INT64)	✅	✅	✅	✅	✅	✅	✅
INTERVAL	✅	✅(1)	✅	✅	❌	✅	✅
JSON	✅	✅(1)	✅	✅(1)	❌	✅	✅
BSON	❌	✅(1)	✅	✅(1)	❌	❌	❌
VARIANT		✅	✅	✅	❌	❌	✅
GEOMETRY	✅	✅	❌	✅	❌	✅	✅
GEOGRAPHY	✅	✅	❌	✅	❌	✅	✅
LIST	✅	✅	✅	✅	✅	(R)	✅
MAP	✅	✅	✅	✅	✅	(R)	✅
UNKNOWN (always null)	✅	✅	✅	✅	✅	✅	✅

Notes:

(1) Only supported to use its annotated physical type

Encodings are defined by the enum Encoding in parquet.thrift and described in Encodings.md

Encoding	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
PLAIN	✅	✅	✅	✅	✅	✅	✅
PLAIN_DICTIONARY	✅	✅	✅	✅	✅	✅	(R)
RLE_DICTIONARY	✅	✅	✅	✅	✅	✅	✅
RLE	✅	✅	✅	✅	✅	✅	✅
BIT_PACKED (deprecated)	✅	✅	✅	❌(1)	(R)	(R)	❌
DELTA_BINARY_PACKED	✅	✅	✅	✅	✅	(R)	✅
DELTA_LENGTH_BYTE_ARRAY	✅	✅	✅	✅	✅	(R)	✅
DELTA_BYTE_ARRAY	✅	✅	✅	✅	✅	(R)	✅
BYTE_STREAM_SPLIT	✅	✅	✅	✅	✅	(R)	✅

Notes:

(1) Partial read support, but only in the case of level data with a bitwidth of 0

Compression	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
UNCOMPRESSED	✅	✅	✅	✅	✅	✅	✅
BROTLI	✅	✅	✅	✅	(R)	(R)	✅
GZIP	✅	✅	✅	✅	(R)	(R)	✅
LZ4 (deprecated)	✅	❌	❌	✅	❌	(R)	❌
LZ4_RAW	✅	✅	✅	✅	✅	(R)	✅
LZO	❌	❌	❌	❌	❌	❌	❌
SNAPPY	✅	✅	✅	✅	✅	✅	✅
ZSTD	✅	✅	✅	✅	✅	(R)	✅

Feature	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
xxHash-based bloom filters	(R)	✅	✅	✅	(R)		✅
Bloom filter length¹	(R)	✅	✅	✅	(R)		✅
Statistics min_value, max_value	✅	✅	✅	✅	✅	✅	✅
Page index	✅	✅	✅	✅	✅	(R)	(R)
Page CRC32 checksum	✅	✅	❌	✅	❌	❌	(R)
Modular encryption	✅	✅	✅	✅	❌	❌	✅(2)
Size statistics³	✅	✅	(R)	✅	✅		(R)
Data Page V2⁴	✅	✅	✅	✅	✅	✅	✅

Notes:

(1) In parquet.thrift: ColumnMetaData->bloom_filter_length

(2) Partial support

(3) In parquet.thrift: ColumnMetaData->size_statistics

(4) In parquet.thrift: DataPageHeaderV2

Feature	arrow	parquet-java	arrow-go	arrow-rs	cudf	hyparquet	duckdb
External column data¹	✅	✅	❌	❌	(W)	✅	❌
Row group "Sorting column" metadata²	✅	❌	✅	✅	(W)	❌	(R)
Row group pruning using statistics	❌	✅	✅(3)	✅	✅	❌	✅
Row group pruning using bloom filter	❌	✅	✅(3)	✅	✅	❌	✅
Reading select columns only	✅	✅	✅	✅	✅	✅	✅
Page pruning using statistics	❌	✅	✅(3)	✅	❌	❌	❌

Notes:

(1) In parquet.thrift: ColumnChunk->file_path

(2) In parquet.thrift: RowGroup->sorting_columns

(3) Partial support