Skip to content

Commit f2a6443

Browse files
committed
Bumping version numbers for 6.4.1 patch release.
1 parent 2b36847 commit f2a6443

File tree

3 files changed

+13
-6
lines changed

3 files changed

+13
-6
lines changed

CHANGELOG

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,13 @@
1616

1717
# spark-redshift Changelog
1818

19+
## 6.4.1 (2025-01-07)
20+
- Corrects an attribute nullability bug when using set operators: UNION, EXCEPT, or INTERSECT [Hari Kishore Chaparala, Beaux Sharifi]
21+
- Adds a missing validation rule for using the Redshift Data API [Beaux Sharifi]
22+
- Modifies the visibility of RedshiftRelation to be public for external access [Armin Najafi]
23+
- Upgrades the connector to work with the latest JDBC driver version 2.1.0.32 [Beaux Sharifi]
24+
- Validates connector tests pass with the latest Spark patch release 3.5.4 [Beaux Sharifi]
25+
1926
## 6.4.0 (2024-12-02)
2027
- Supports utilizing the Redshift Data API as an alternative mechanism for communicating with Redshift (see parameters "data_api_*" in the README). [Beaux Sharifi]
2128
- Adds DML pushdown support for four Spark SQL operators: INSERT, DELETE, UPDATE, and MERGE. [Hari Kishore Chaparala, Ruei Yang Huang, Xiaoxuan Li, Beaux Sharifi, Brooke White]

README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,7 @@ You may use this library in your applications with the following dependency info
104104
spark-submit \
105105
--deploy-mode cluster \
106106
--master yarn \
107-
--packages com.amazon.redshift:redshift-jdbc42:2.1.0.32,org.apache.spark:spark-avro_2.12:3.5.4,io.github.spark-redshift-community:spark-redshift_2.12:6.4.0-spark_3.5 \
107+
--packages com.amazon.redshift:redshift-jdbc42:2.1.0.32,org.apache.spark:spark-avro_2.12:3.5.4,io.github.spark-redshift-community:spark-redshift_2.12:6.3.0-spark_3.5 \
108108
my_script.py
109109
```
110110

@@ -115,14 +115,14 @@ You may use this library in your applications with the following dependency info
115115
<dependency>
116116
<groupId>io.github.spark-redshift-community</groupId>
117117
<artifactId>spark-redshift_2.12</artifactId>
118-
<version>6.4.0-spark_3.5</version>
118+
<version>6.3.0-spark_3.5</version>
119119
</dependency>
120120
```
121121

122122
- **In SBT**:
123123

124124
```SBT
125-
libraryDependencies += "io.github.spark-redshift-community" %% "spark-redshift_2.12" % "6.4.0-spark_3.5"
125+
libraryDependencies += "io.github.spark-redshift-community" %% "spark-redshift_2.12" % "6.3.0-spark_3.5"
126126
```
127127

128128

@@ -887,7 +887,7 @@ for more information.</p>
887887
<td>""</td>
888888
<td>
889889
An identifier to include in the query group set when running queries with the connector. Should be 100 or fewer characters and all characters must be valid unicodeIdentifierParts. Characters in excess of 100 will be trimmed.
890-
When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.4.0-spark_3.5","op":"Read","lbl":"","tid":""}}`).
890+
When running a query with the connector a json formatted string will be set as the query group (for example `{"spark-redshift-connector":{"svc":"","ver":"6.4.1-spark_3.5","op":"Read","lbl":"","tid":""}}`).
891891
This option will be substituted for the value of the `lbl` key.
892892
</td>
893893
</tr>
@@ -1044,7 +1044,7 @@ SET spark.datasource.redshift.community.autopushdown.lazyMode=false
10441044
### trace_id
10451045
A new tracing identifier field that is added to the existing `label` parameter. When set, the provided string value will be used as part of label. Otherwise, it will default to the Spark application identifier. For example:
10461046
1047-
`{"spark-redshift-connector":{"svc":"","ver":"6.4.0-spark_3.5","op":"Read","lbl":"","tid":"..."}}`)
1047+
`{"spark-redshift-connector":{"svc":"","ver":"6.4.1-spark_3.5","op":"Read","lbl":"","tid":"..."}}`)
10481048
10491049
To set the value, run the following command:
10501050
```sparksql

version.sbt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,4 +14,4 @@
1414
* limitations under the License.
1515
*/
1616

17-
ThisBuild / version := "6.4.0"
17+
ThisBuild / version := "6.4.1"

0 commit comments

Comments
 (0)