> For the complete documentation index, see [llms.txt](https://docs.starrocks.io/llms.txt). This page is also available as Markdown at its `.md` URL.

# Releases of StarRocks Connector for Spark

## Notifications[​](#notifications "Direct link to Notifications")

**User guide:**

* [Load data into StarRocks using Spark connector](https://docs.starrocks.io/docs/loading/Spark-connector-starrocks/)
* [Read data from StarRocks using Spark connector](https://docs.starrocks.io/docs/unloading/Spark_connector/)

**Source codes**: [starrocks-connector-for-apache-spark](https://github.com/StarRocks/starrocks-connector-for-apache-spark)

**Naming format of the JAR file**: `starrocks-spark-connector-${spark_version}_${scala_version}-${connector_version}.jar`

**Methods to obtain the JAR file:**

* Directly download the Spark connector JAR file from the [Maven Central Repository](https://repo1.maven.org/maven2/com/starrocks).
* Add the Spark connector as a dependency in your Maven project's `pom.xml` file and download it. For specific instructions, see [user guide](https://docs.starrocks.io/docs/loading/Spark-connector-starrocks/#obtain-spark-connector).
* Compile the source codes into Spark connector JAR file. For specific instructions, see [user guide](https://docs.starrocks.io/docs/loading/Spark-connector-starrocks/#obtain-spark-connector).

**Version requirements:**

| Spark connector | Spark              | StarRocks      | Java | Scala |
| --------------- | ------------------ | -------------- | ---- | ----- |
| 1.1.4           | 4.0, 4.1           | 2.5 and later  | 17   | 2.13  |
| 1.1.4           | 3.3, 3.4, 3.5      | 2.5 and later  | 8    | 2.12  |
| 1.1.3           | 3.2, 3.3, 3.4, 3.5 | 2.5 and later  | 8    | 2.12  |
| 1.1.2           | 3.2, 3.3, 3.4, 3.5 | 2.5 and later  | 8    | 2.12  |
| 1.1.1           | 3.2, 3.3, or 3.4   | 2.5 and later  | 8    | 2.12  |
| 1.1.0           | 3.2, 3.3, or 3.4   | 2.5 and later  | 8    | 2.12  |
| 1.0.0           | 3.x                | 1.18 and later | 8    | 2.12  |
| 1.0.0           | 2.x                | 1.18 and later | 8    | 2.11  |

## Release notes[​](#release-notes "Direct link to Release notes")

### 1.1[​](#11 "Direct link to 1.1")

#### 1.1.4[​](#114 "Direct link to 1.1.4")

This release mainly includes some features and improvements.

**Features**

* Added support for StarRocks catalog. [#109](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/109)
* Added support for `bitmap_hash64`. [#130](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/130)
* Supports nested fields (Structs, Arrays, and Maps). [#152](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/152)
* Supports reading and writing through Spark catalog. [#140](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/140)
* Supports Spark 4.0 and Scala 2.13. [#154](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/154)

**Improvements**

* Added the security policy. [#139](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/139)

**BugFix**

* Incorrect filter pushdown in DataSource V2. [#141](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/141)

#### 1.1.3[​](#113 "Direct link to 1.1.3")

This release mainly includes some features and improvements.

**Features**

* Sink supports LZ4 compression. [#110](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/110)

**Improvements**

* Supports reading and writing StarRocks DATETIME data type with microseconds. [#123](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/123)
* Supports configuring the socket timeout for write. [#122](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/122)
* Enlarged the maximum string length of `jackson-core`. [#129](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/129)

**BugFix**

* Parse error caused by keywords used as column names. (After the bug fix, quotes are added to column names in BuildScan.) [#103](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/103)
* Exception caused by that `java.lang.String` is not a valid external type for DATE/TIMESTAMP. [#111](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/111)
* The JSON type was written incorrectly. [#115](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/115)

#### 1.1.2[​](#112 "Direct link to 1.1.2")

**Features**

* Supports Spark v3.5. [#89](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/89)
* Supports the `starrocks.filter.query` parameter when Spark SQL is used to read data from StarRocks. [#92](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/92)
* Supports reading columns of JSON type from StarRocks. [#100](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/100)

**Improvements**

* Optimized error messages. When Spark connector reads data from StarRocks, and columns specified in the `starrocks.columns` parameter do not exist in the StarRocks table, the returned error message explicitly shows the names of columns that do not exist. [#97](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/97)
* If an exception occurs when Spark connector requests a query plan from StarRocks FE via HTTP, the FE will return the exception information to the Spark connector through the HTTP status and entity. [#98](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/98)

#### 1.1.1[​](#111 "Direct link to 1.1.1")

This release mainly includes some features and improvements for loading data to StarRocks.

> **NOTICE**
>
> Take note of the some changes when you upgrade the Spark connector to this version. For details, see [Upgrade Spark connector](https://docs.starrocks.io/docs/loading/Spark-connector-starrocks/#upgrade-from-version-110-to-111).

**Features**

* The sink supports retrying. [#61](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/61)
* Support to load data to BITMAP and HLL columns. [#67](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/67)
* Support to load ARRAY-type data. [#74](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/74)
* Support to flush according to the number of buffered rows. [#78](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/78)

**Improvements**

* Remove useless dependency, and make the Spark connector JAR file lightweight. [#55](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/55) [#57](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/57)
* Replace fastjson with jackson. [#58](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/58)
* Add the missing Apache license header. [#60](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/60)
* Do not package the MySQL JDBC driver in the Spark connector JAR file. [#63](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/63)
* Support to configure timezone parameter and become compatible with Spark Java8 API datetime. [#64](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/64)
* Optimize row-string converter to reduce CPU costs. [#68](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/68)
* The `starrocks.fe.http.url` parameter supports to add a http scheme. [#71](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/71)
* The interface BatchWrite#useCommitCoordinator is implemented to run on DataBricks 13.1 [#79](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/79)
* Add the hint of checking the privileges and parameters in the error log. [#81](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/81)

**Bug fixes**

* Parse escape characters in the CSV related parameters `column_separator` and `row_delimiter`. [#85](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/85)

**Doc**

* Refactor the docs. [#66](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/66)
* Add examples of load data to BITMAP and HLL columns. [#70](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/70)
* Add examples of Spark applications written in Python. [#72](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/72)
* Add examples of loading ARRAY-type data. [#75](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/75)
* Add examples for performing partial updates and conditional updates on Primary Key tables. [#80](https://github.com/StarRocks/starrocks-connector-for-apache-spark/pull/80)

**1.1.0**

**Features**

* Support to load data into StarRocks.

### 1.0[​](#10 "Direct link to 1.0")

**Features**

* Support to unload data from StarRocks.