v7.0.1

What's Changed

Bug fixes

• Fix issue with CORS not working when authentication is disabled by @johngrimes in #1927

Full Changelog: v7.0.0...v7.0.1

v7.0.0

What's Changed

New features

• Full encoding and decoding support for References by @piotrszul in #1786 (also see #1784 from @chgl)
• Save mode (append, error, overwrite or ignore) can now be set when saving a data source to Parquet and NDJSON formats through the library API

Bug fixes

• Fixed a bug where year-only dates passed to the until function would always return an empty result

Dependency updates

• Upgraded from Java 11 to 17
• Upgraded to Spark 3.5.1
• Upgraded to Delta Lake 3.2.0
• Upgraded to HAPI 7.0.2
• Upgraded to Spring Boot 3.2.0

Changes to defaults

• databricks.delta.schema.autoMerge.enabled is now set to false by default in the server (see #1785 from @chgl)

Important note: Because this release contains schema changes, you may need to re-import your data.

If you override JVM options (or JAVA_TOOL_OPTIONS in the case of the Docker image), you may need to add --add-exports=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED. This is a new requirement due to tighter controls over class access in Java 17.

Full Changelog: v6.4.2...v7.0.0

v6.4.2

What's Changed

Bug fixes

• #1774 Fixed: pathling_install_spark() does not work by @johngrimes

Full Changelog: v6.4.1...v6.4.2

v6.4.1

Changes to the R library relating to CRAN submission.

Pathling is now available via CRAN! 👉 https://cran.r-project.org/package=pathling

v6.4.0

What's Changed

New features

• Added R API by @piotrszul in #1611
• Added Spring Boot Actuator and metrics endpoints by @chgl in #1673
• Implement reusing of async jobs for equivalent requests by @piotrszul in #1414
• Added Helm chart for deploying on Kubernetes by @johngrimes

New Contributors

• @jkiddo made their first contribution in #1772
• @chgl made their first contribution in #1673

R package

The full set of Pathling functionality is now available as an R package!

Check out the libraries documentation for information on how to install the package, along with examples of how to use it.

We're currently working on getting the package uploaded to CRAN for a simpler installation experience.

Full Changelog: v6.3.1...v6.4.0

v6.3.1

Bug fixes

• Logging broken by upgrade to SLF4J 2 #1556

Full Changelog: v6.3.0...v6.3.1

v6.3.0

This release adds a new feature - terminology client language configuration. This allows you to control the preferred language that is requested from the terminology server for operations such as display and property.

Check out the documentation here: Multi-language support

What's Changed

New features

• Preferred language configuration parameter by @Markopolo141 in #1256

Full Changelog: v6.2.3...v6.3.0

v6.2.3

What's Changed

Bug fixes

• Fix problems with resolution of git.properties by giving it a unique name by @johngrimes in #1505
• Implemented aliasing of the literal value columns. by @piotrszul in #1499
• Create library runtime jar by @piotrszul in #1510

Important note

The recommended Maven artifact to use when installing Pathling as a Spark Package has changed from library-api to library-runtime. This new artifact is a shaded JAR, built to help address problems caused by classpath conflicts between cluster and Pathling dependencies.

Please review the instructions for installing Pathling to Databricks or your own cluster.

Full Changelog: v6.2.2...v6.2.3

v6.2.2

What's Changed

Bug fixes

• Adding cleaning up of the resources owned by the terminology service by @piotrszul in #1391

Full Changelog: v6.2.1...v6.2.2

v6.2.1

v6.2.1