Skip to content

bump parquet-1.15.2#64

Open
ostinru wants to merge 1 commit intoapache:mainfrom
ostinru:parquet-1.15.2-v2
Open

bump parquet-1.15.2#64
ostinru wants to merge 1 commit intoapache:mainfrom
ostinru:parquet-1.15.2-v2

Conversation

@ostinru
Copy link
Collaborator

@ostinru ostinru commented Feb 14, 2026

Apache Parquet

Bump Parquet version from 1.12.3 to 1.15.2.

Useful changes in Parquet 1.12.x -> 1.15.x

  • Support LZ4_RAW codec
  • Implement vectored IO in parquet file format
  • More optimal memory usage in compression codecs

Dependency tree changes are small:

+--- org.apache.parquet:parquet-column:1.15.1
|    +--- org.apache.parquet:parquet-common:1.15.1
|    |    +--- org.apache.parquet:parquet-format-structures:1.15.1
|    +--- org.apache.parquet:parquet-encoding:1.15.1
|    |    +--- org.apache.parquet:parquet-common:1.15.1 (*)
+--- org.apache.parquet:parquet-hadoop:1.15.1
|    +--- org.apache.parquet:parquet-column:1.15.1 (*)
|    +--- org.apache.parquet:parquet-format-structures:1.15.1 (*)
|    +--- org.apache.parquet:parquet-common:1.15.1 (*)
|    +--- org.xerial.snappy:snappy-java:1.1.10.7
|    +--- io.airlift:aircompressor:2.0.2
|    +--- commons-pool:commons-pool:1.6
|    +--- com.github.luben:zstd-jni:1.5.6-6
+--- org.apache.parquet:parquet-jackson:1.15.1
+--- org.apache.parquet:parquet-generator:1.15.1
+--- org.apache.parquet:parquet-pig:1.15.1
|    +--- org.apache.parquet:parquet-column:1.15.1 (*)
|    +--- org.apache.parquet:parquet-hadoop:1.15.1 (*)
|    +--- org.apache.parquet:parquet-common:1.15.1 (*)
\--- org.apache.parquet:parquet-format:2.10.0

It has its own thrift library shaded. It doesn't depend on protobuf.
parquet-hadoop in fact expects that there is hadoop-client, hadoop-common, hadoop-annotations and hadoop-mapreduce-client-core provided.

@ostinru
Copy link
Collaborator Author

ostinru commented Feb 14, 2026

HBASE upgrade unlock Apache Parquet update. Originally, HBASE tests failed with fresh parquet due to issues in dependencies.

@ostinru ostinru marked this pull request as ready for review February 16, 2026 11:46
@ostinru
Copy link
Collaborator Author

ostinru commented Feb 16, 2026

Tested with Hadoop 3.2.2 - works well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant