Add Config support via FFI

Cargo.toml

@@ -17,7 +17,7 @@
 
 [package]
 name = "datafusion-python"
-version = "50.1.0"
+version = "51.0.0"
 homepage = "https://datafusion.apache.org/python"
 repository = "https://github.com/apache/datafusion-python"
 authors = ["Apache DataFusion <[email protected]>"]
@@ -90,3 +90,10 @@ crate-type = ["cdylib", "rlib"]
 [profile.release]
 lto = true
 codegen-units = 1
+
+
+[patch.crates-io]
+datafusion = { git = "https://github.com/timsaucer/datafusion", branch = "feat/ffi-config-options" }
+datafusion-substrait = { git = "https://github.com/timsaucer/datafusion", branch = "feat/ffi-config-options" }
+datafusion-proto = { git = "https://github.com/timsaucer/datafusion", branch = "feat/ffi-config-options" }
+datafusion-ffi = { git = "https://github.com/timsaucer/datafusion", branch = "feat/ffi-config-options" }

dev/changelog/51.0.0.md

@@ -0,0 +1,74 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Python 51.0.0 Changelog
+
+This release consists of 23 commits from 7 contributors. See credits at the end of this changelog for more information.
+
+**Breaking changes:**
+
+- feat: reduce duplicate fields on join [#1184](https://github.com/apache/datafusion-python/pull/1184) (timsaucer)
+
+**Implemented enhancements:**
+
+- feat: expose `select_exprs` method on DataFrame [#1271](https://github.com/apache/datafusion-python/pull/1271) (milenkovicm)
+- feat: allow DataFrame.filter to accept SQL strings [#1276](https://github.com/apache/datafusion-python/pull/1276) (K-dash)
+- feat: add temporary view option for into_view [#1267](https://github.com/apache/datafusion-python/pull/1267) (timsaucer)
+- feat: support session token parameter for AmazonS3 [#1275](https://github.com/apache/datafusion-python/pull/1275) (GCHQDeveloper028)
+- feat: `with_column` supports SQL expression [#1284](https://github.com/apache/datafusion-python/pull/1284) (milenkovicm)
+- feat: Add SQL expression for `repartition_by_hash` [#1285](https://github.com/apache/datafusion-python/pull/1285) (milenkovicm)
+- feat: Add SQL expression support for `with_columns` [#1286](https://github.com/apache/datafusion-python/pull/1286) (milenkovicm)
+
+**Fixed bugs:**
+
+- fix: use coalesce instead of drop_duplicate_keys for join [#1318](https://github.com/apache/datafusion-python/pull/1318) (mesejo)
+- fix: Inconsistent schemas when converting to pyarrow [#1315](https://github.com/apache/datafusion-python/pull/1315) (nuno-faria)
+
+**Other:**
+
+- Release 50.1 [#1281](https://github.com/apache/datafusion-python/pull/1281) (timsaucer)
+- Update python minimum version to 3.10 [#1296](https://github.com/apache/datafusion-python/pull/1296) (timsaucer)
+- chore: update datafusion minor version [#1297](https://github.com/apache/datafusion-python/pull/1297) (timsaucer)
+- Enable remaining pylints [#1298](https://github.com/apache/datafusion-python/pull/1298) (timsaucer)
+- Add Arrow C streaming, DataFrame iteration, and OOM-safe streaming execution [#1222](https://github.com/apache/datafusion-python/pull/1222) (kosiew)
+- Add PyCapsule Type Support and Type Hint Enhancements for AggregateUDF in DataFusion Python Bindings [#1277](https://github.com/apache/datafusion-python/pull/1277) (kosiew)
+- Add collect_column to dataframe [#1302](https://github.com/apache/datafusion-python/pull/1302) (timsaucer)
+- chore: apply cargo fmt with import organization [#1303](https://github.com/apache/datafusion-python/pull/1303) (timsaucer)
+- Feat/parameterized sql queries [#964](https://github.com/apache/datafusion-python/pull/964) (timsaucer)
+- Upgrade to Datafusion 51 [#1311](https://github.com/apache/datafusion-python/pull/1311) (nuno-faria)
+- minor: resolve build errors after latest merge into main [#1325](https://github.com/apache/datafusion-python/pull/1325) (timsaucer)
+- Update build workflow link [#1330](https://github.com/apache/datafusion-python/pull/1330) (timsaucer)
+- Do not convert pyarrow scalar values to plain python types when passing as `lit` [#1319](https://github.com/apache/datafusion-python/pull/1319) (timsaucer)
+
+## Credits
+
+Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
+
+```
+    12	Tim Saucer
+     4	Marko Milenković
+     2	Nuno Faria
+     2	kosiew
+     1	Daniel Mesejo
+     1	GCHQDeveloper028
+     1	𝕂
+```
+
+Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.
+

dev/release/README.md

@@ -81,6 +81,9 @@ Generating changelog content
 ### Update the version number
 
 The only place you should need to update the version is in the root `Cargo.toml`.
+After updating the toml file, run `cargo update` to update the cargo lock file.
+If you do not want to update all the dependencies, you can instead run `cargo build`
+which should only update the version number for `datafusion-python`.
 
 ### Tag the Repository