Support writing with functions in distribute/partition expressions#253

Open

Yxang wants to merge 20 commits intoClickHouse:mainfrom

Yxang:master

Commits on Jul 25, 2023

Spark 3.4: Support distribute by any predefined transform
Yxang
committed
Spark 3.4: add udf: years, days, hours, murmurHash2 and murmurHash3. Amend testing
Yxang
committed
Spark 3.4: Fixup sharding key needs to be mod by cluster weight on local sort
Yxang
committed
Scala 2.13: Fix Spark 3.4 compile issue
Yxang
committed
Spark 3.4: Optimize sharding key handling when shuffle and sort
Yxang
committed
Spark 3.4: Optimize sharding key handling when shuffle and sort, approach 2
Yxang
committed
Spark 3.4: Support variable length arguments for murmurHash (up to 5 string arguments)
Yxang
committed
Spark 3.4: add CityHash64
Yxang
committed
Spark 3.4: Optimize sharding key handling when shuffle and sort, approach 3
Yxang
committed
Spark 3.4 UDF: Amend input type, Make clickhouse function nullable, better spark help text
Yxang
committed
Spark 3.4: Optimize sharding key handling when shuffle and sort, amend approach 3
Yxang
committed
Spark 3.4: Change ExprUtils to implicit
Yxang
committed
Spark 3.4 UDF: clickhouse code reference using tag from commit hash
Yxang
committed
Spark 3.4 UDF: support varargs for Hash UDFs
Yxang
committed
Spark 3.4: refactor implicit into normal arg in ExprUtils
Yxang
committed
Spark 3.4: Cast type when calling projection, support recursive resolve
Yxang
committed
Spark 3.4 UDF: change pmod to mod because positiveModulo does not exists in early version of clickhouse
Yxang
committed
Docs: add comment for modulo UDF
Yxang
committed
Spark 3.4: Adapt to hash function under clickhouse-core
Yxang
committed

Commits on Jul 26, 2023

fix style
Yxang
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Support writing with functions in distribute/partition expressions#253

Support writing with functions in distribute/partition expressions#253
Yxang wants to merge 20 commits intoClickHouse:mainfrom
Yxang:master

Commits on Jul 25, 2023

Spark 3.4: Support distribute by any predefined transform

Spark 3.4: add udf: years, days, hours, murmurHash2 and murmurHash3. Amend testing

Spark 3.4: Fixup sharding key needs to be mod by cluster weight on local sort

Scala 2.13: Fix Spark 3.4 compile issue

Spark 3.4: Optimize sharding key handling when shuffle and sort

Spark 3.4: Optimize sharding key handling when shuffle and sort, approach 2

Spark 3.4: Support variable length arguments for murmurHash (up to 5 string arguments)

Spark 3.4: add CityHash64

Spark 3.4: Optimize sharding key handling when shuffle and sort, approach 3

Spark 3.4 UDF: Amend input type, Make clickhouse function nullable, better spark help text

Spark 3.4: Optimize sharding key handling when shuffle and sort, amend approach 3

Spark 3.4: Change ExprUtils to implicit

Spark 3.4 UDF: clickhouse code reference using tag from commit hash

Spark 3.4 UDF: support varargs for Hash UDFs

Spark 3.4: refactor implicit into normal arg in ExprUtils

Spark 3.4: Cast type when calling projection, support recursive resolve

Spark 3.4 UDF: change pmod to mod because positiveModulo does not exists in early version of clickhouse

Docs: add comment for modulo UDF

Spark 3.4: Adapt to hash function under clickhouse-core

Commits on Jul 26, 2023

fix style

Support writing with functions in distribute/partition expressions#253Yxang wants to merge 20 commits intoClickHouse:mainClickHouse/spark-clickhouse-connector:mainfrom Yxang:masterYxang/spark-clickhouse-connector:masterCopy head branch name to clipboard

Commits

Commits on Jul 25, 2023

Commits on Jul 26, 2023

Support writing with functions in distribute/partition expressions#253
Yxang wants to merge 20 commits intoClickHouse:mainfrom
Yxang:master