You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG
+7Lines changed: 7 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -16,6 +16,13 @@
16
16
17
17
# spark-redshift Changelog
18
18
19
+
## 6.4.1 (2025-01-07)
20
+
- Corrects an attribute nullability bug when using set operators: UNION, EXCEPT, or INTERSECT [Hari Kishore Chaparala, Beaux Sharifi]
21
+
- Adds a missing validation rule for using the Redshift Data API [Beaux Sharifi]
22
+
- Modifies the visibility of RedshiftRelation to be public for external access [Armin Najafi]
23
+
- Upgrades the connector to work with the latest JDBC driver version 2.1.0.32 [Beaux Sharifi]
24
+
- Validates connector tests pass with the latest Spark patch release 3.5.4 [Beaux Sharifi]
25
+
19
26
## 6.4.0 (2024-12-02)
20
27
- Supports utilizing the Redshift Data API as an alternative mechanism for communicating with Redshift (see parameters "data_api_*" in the README). [Beaux Sharifi]
21
28
- Adds DML pushdown support for four Spark SQL operators: INSERT, DELETE, UPDATE, and MERGE. [Hari Kishore Chaparala, Ruei Yang Huang, Xiaoxuan Li, Beaux Sharifi, Brooke White]
An identifier to include in the query group set when running queries with the connector. Should be 100 or fewer characters and all characters must be valid unicodeIdentifierParts. Characters in excess of 100 will be trimmed.
890
-
When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.4.0-spark_3.5","op":"Read","lbl":"","tid":""}}`).
890
+
When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.4.1-spark_3.5","op":"Read","lbl":"","tid":""}}`).
891
891
This option will be substituted for the value of the `lbl` key.
892
892
</td>
893
893
</tr>
@@ -1044,7 +1044,7 @@ SET spark.datasource.redshift.community.autopushdown.lazyMode=false
1044
1044
### trace_id
1045
1045
A new tracing identifier field that is added to the existing `label` parameter. When set, the provided string value will be used as part of label. Otherwise, it will default to the Spark application identifier. For example:
0 commit comments