1.3.2: Update dependencies on top of 1.3.1

Summary

This release fixes vulnerabilities in the following compile time dependencies:

• org.xerial.snappy:snappy-java
  • CVE-2023-34453, severity CWE-190: Integer Overflow or Wraparound (7.5)
  • CVE-2023-34454, severity CWE-190: Integer Overflow or Wraparound (7.5)
  • CVE-2023-34455, severity CWE-770: Allocation of Resources Without Limits or Throttling (7.5)
• io.netty:netty-handler
  • CVE-2023-34462, severity CWE-770: Allocation of Resources Without Limits or Throttling (6.5)

Security

• #33: Updated dependencies

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.22.0 to 12.22.3
• Updated com.exasol:virtual-schema-common-document-files:7.3.2 to 7.3.3
• Added org.slf4j:slf4j-jdk14:2.0.7

Test Dependency Updates

• Updated com.exasol:exasol-test-setup-abstraction-java:2.0.1 to 2.0.2
• Updated com.exasol:virtual-schema-common-document-files:7.3.2 to 7.3.3
• Updated org.mockito:mockito-core:5.3.1 to 5.4.0
• Updated org.testcontainers:junit-jupiter:1.18.0 to 1.18.3

1.3.1: CSV Performance Regression Tests

Summary

This release updates performance regression rests for CSV files to use all data types (string, boolean, integer, double, date and timestamp) instead of only string. Please note that this might influence comparability of test results. Additionally the test names in the test report changed. They now use suffix () instead of (TestInfo).

Tests

• #31: Added CSV data type performance regression tests

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document-files:7.3.0 to 7.3.2

Test Dependency Updates

• Updated com.exasol:virtual-schema-common-document-files:7.3.0 to 7.3.2

1.3.0: Auto-inference for CSV

Summary

This release adds more mapping types for CSV files. Before you could only use mapping toVarcharMapping, but now you can also use toDecimalMapping, toDoubleMapping, toDateMapping and toTimestampMapping.

The release also adds automatic schema inference for CSV files. This means that you don't need to specify a mapping element in the EDML definition. Instead the virtual schema will automatically detect the mapping from the CSV file as well as the presence of a header line.

See the EDML user guide for details.

Features

• #29: Added automatic schema inference for CSV files

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.21.1 to 12.22.0
• Updated com.exasol:virtual-schema-common-document-files:7.2.0 to 7.3.0

Test Dependency Updates

• Updated com.exasol:exasol-test-setup-abstraction-java:2.0.0 to 2.0.1
• Removed com.exasol:exasol-testcontainers:6.5.1
• Updated com.exasol:hamcrest-resultset-matcher:1.5.2 to 1.6.0
• Updated com.exasol:virtual-schema-common-document-files:7.2.0 to 7.3.0
• Updated org.jacoco:org.jacoco.agent:0.8.8 to 0.8.9
• Removed org.junit.jupiter:junit-jupiter-engine:5.9.2
• Updated org.junit.jupiter:junit-jupiter-params:5.9.2 to 5.9.3
• Updated org.mockito:mockito-core:5.2.0 to 5.3.1
• Updated org.testcontainers:junit-jupiter:1.17.6 to 1.18.0

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:1.2.2 to 1.2.3
• Updated com.exasol:project-keeper-maven-plugin:2.9.6 to 2.9.7
• Updated org.apache.maven.plugins:maven-compiler-plugin:3.10.1 to 3.11.0
• Updated org.apache.maven.plugins:maven-enforcer-plugin:3.2.1 to 3.3.0
• Updated org.apache.maven.plugins:maven-failsafe-plugin:3.0.0-M8 to 3.0.0
• Updated org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M8 to 3.0.0
• Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
• Updated org.codehaus.mojo:flatten-maven-plugin:1.3.0 to 1.4.1
• Updated org.codehaus.mojo:versions-maven-plugin:2.14.2 to 2.15.0
• Updated org.jacoco:jacoco-maven-plugin:0.8.8 to 0.8.9

1.2.1: Fix performance regression tests

Summary

This release fixes execution of performance regression tests.

Bugfixes

• #25: Fixed performance regression tests

1.2.0: Auto-inference for Parquet

Summary

This release adds automatic schema inference for Parquet files. This means that you don't need to specify a mapping element in the EDML definition. Instead VSBFS will automatically detect the mapping from the Parquet files. See the EDML user guide for details.

The release also refactored class LocalAbsTestSetup.

Features

• #22: Added auto-inference for Parquet files

Refactoring

• #20: Refactored class LocalAbsTestSetup.

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.20.2 to 12.21.1
• Updated com.exasol:error-reporting-java:1.0.0 to 1.0.1
• Updated com.exasol:virtual-schema-common-document-files:7.1.4 to 7.2.0
• Removed com.fasterxml.jackson.core:jackson-annotations:2.14.2
• Removed com.fasterxml.jackson.core:jackson-core:2.14.2
• Removed com.fasterxml.jackson.core:jackson-databind:2.14.2

Test Dependency Updates

• Added com.exasol:exasol-testcontainers:6.5.1
• Updated com.exasol:udf-debugging-java:0.6.7 to 0.6.8
• Updated com.exasol:virtual-schema-common-document-files:7.1.4 to 7.2.0
• Removed commons-net:commons-net:3.9.0
• Updated org.mockito:mockito-core:5.1.1 to 5.2.0
• Removed org.yaml:snakeyaml:1.33

Plugin Dependency Updates

• Updated com.exasol:project-keeper-maven-plugin:2.9.3 to 2.9.6
• Updated org.apache.maven.plugins:maven-assembly-plugin:3.4.2 to 3.5.0
• Updated org.apache.maven.plugins:maven-enforcer-plugin:3.1.0 to 3.2.1
• Removed org.projectlombok:lombok-maven-plugin:1.18.20.0

Reviewed and fixed vulnerabilities, updated dependencies and refactored integration test setup class.

Summary

Reviewed and fixed vulnerabilities.
Refactored IntegrationTestSetup to use system properties.

Bugfixes / Vulnerabilities

• Fixed vulnerabilities
  • CVE-2021-37533 - Overrode transitive test dependency to fix vulnerability.
• Ignored vulnerabilities
  • sonatype-2022-6438 - Exploit requires write access to the source code repository and attempts to inject malicious code will be detected during regular code reviews.
  • CVE-2020-36641 - Vulnerability is rated as a false positive since CVE-2020-36641 is reported to be fixed in aXMLRPC 1.12.1, while ETAJ uses version 1.13.0.
  • CVE-2022-1471 - Dependency is used by the test framework.
  • CVE-2020-36641 - Exploit requires access to manipulate hosted JSON files.

Refactoring

*#15 : Use system properties to set DEBUG_ADDRESS and LOG_LEVEL.

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.20.0 to 12.20.2
• Updated com.exasol:virtual-schema-common-document-files:7.1.2 to 7.1.4
• Updated com.fasterxml.jackson.core:jackson-annotations:2.13.4 to 2.14.2
• Updated com.fasterxml.jackson.core:jackson-core:2.13.4 to 2.14.2
• Updated com.fasterxml.jackson.core:jackson-databind:2.13.4.2 to 2.14.2

Test Dependency Updates

• Updated com.exasol:exasol-test-setup-abstraction-java:0.3.2 to 2.0.0
• Updated com.exasol:test-db-builder-java:3.4.1 to 3.4.2
• Updated com.exasol:udf-debugging-java:0.6.4 to 0.6.7
• Updated com.exasol:virtual-schema-common-document-files:7.1.2 to 7.1.4
• Added commons-net:commons-net:3.9.0
• Updated org.junit.jupiter:junit-jupiter-engine:5.9.1 to 5.9.2
• Updated org.junit.jupiter:junit-jupiter-params:5.9.1 to 5.9.2
• Updated org.mockito:mockito-core:4.8.1 to 5.1.1
• Updated org.testcontainers:junit-jupiter:1.17.5 to 1.17.6

Plugin Dependency Updates

• Updated com.exasol:artifact-reference-checker-maven-plugin:0.4.0 to 0.4.2
• Updated com.exasol:error-code-crawler-maven-plugin:1.1.2 to 1.2.2
• Updated com.exasol:project-keeper-maven-plugin:2.8.0 to 2.9.3
• Updated io.github.zlika:reproducible-build-maven-plugin:0.15 to 0.16
• Updated org.apache.maven.plugins:maven-assembly-plugin:3.3.0 to 3.4.2
• Updated org.apache.maven.plugins:maven-dependency-plugin:3.3.0 to 3.5.0
• Updated org.apache.maven.plugins:maven-failsafe-plugin:3.0.0-M5 to 3.0.0-M8
• Updated org.apache.maven.plugins:maven-jar-plugin:3.2.2 to 3.3.0
• Updated org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5 to 3.0.0-M8
• Updated org.codehaus.mojo:flatten-maven-plugin:1.2.7 to 1.3.0
• Updated org.codehaus.mojo:versions-maven-plugin:2.10.0 to 2.14.2

Fixed vulnerabilities

Summary

• Fixed vulnerabilities
• Updated dependencies
• Updated azurite emulator

Bug fixes

• #16: Fix cves/vulnerabilities/update dependencies

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.17.1 to 12.20.0
• Updated com.exasol:error-reporting-java:0.4.1 to 1.0.0
• Updated com.exasol:virtual-schema-common-document-files:7.1.1 to 7.1.2
• Updated com.fasterxml.jackson.core:jackson-annotations:2.13.3 to 2.13.4
• Updated com.fasterxml.jackson.core:jackson-core:2.13.3 to 2.13.4
• Added com.fasterxml.jackson.core:jackson-databind:2.13.4.2

Test Dependency Updates

• Updated com.exasol:hamcrest-resultset-matcher:1.5.1 to 1.5.2
• Updated com.exasol:performance-test-recorder-java:0.1.0 to 0.1.2
• Updated com.exasol:test-db-builder-java:3.3.4 to 3.4.1
• Updated com.exasol:virtual-schema-common-document-files:7.1.1 to 7.1.2
• Updated org.mockito:mockito-core:4.6.1 to 4.8.1
• Updated org.testcontainers:junit-jupiter:1.17.2 to 1.17.5

1.1.1 Fix CVE Warnings + Dependency Updates

Summary

• #13 - Fix CVE Warnings + Dependency Updates

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document-files:7.1.0 to 7.1.1

Test Dependency Updates

• Updated com.exasol:test-db-builder-java:3.3.3 to 3.3.4
• Updated com.exasol:virtual-schema-common-document-files:7.1.0 to 7.1.1
• Updated org.junit.jupiter:junit-jupiter-engine:5.8.2 to 5.9.1
• Updated org.junit.jupiter:junit-jupiter-params:5.8.2 to 5.9.1
• Updated org.yaml:snakeyaml:1.30 to 1.33

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:1.1.1 to 1.1.2
• Updated com.exasol:project-keeper-maven-plugin:2.4.6 to 2.8.0
• Updated org.apache.maven.plugins:maven-enforcer-plugin:3.0.0 to 3.1.0

1.1.0 CSV Support

Summary

Features

• Added CSV Support

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document-files:7.0.2 to 7.1.0

Test Dependency Updates

• Updated com.exasol:test-db-builder-java:3.3.2 to 3.3.3
• Updated com.exasol:udf-debugging-java:0.6.1 to 0.6.4
• Updated com.exasol:virtual-schema-common-document-files:7.0.2 to 7.1.0
• Removed org.testcontainers:localstack:1.17.2

1.0.1: Upgrade dependencies on 1.0.0

Summary

This release upgrades dependencies and adapts the collection of regression tests results.

Refactoring

• #9: Adapted to new regression test result database

Dependency Updates

Compile Dependency Updates

• Updated com.azure:azure-storage-blob:12.14.3 to 12.17.1
• Updated com.exasol:virtual-schema-common-document-files:6.0.1 to 7.0.2
• Updated com.fasterxml.jackson.core:jackson-annotations:2.13.1 to 2.13.3
• Updated com.fasterxml.jackson.core:jackson-core:2.13.1 to 2.13.3

Test Dependency Updates

• Updated com.exasol:exasol-test-setup-abstraction-java:0.2.2 to 0.3.2
• Added com.exasol:performance-test-recorder-java:0.1.0
• Updated com.exasol:test-db-builder-java:3.2.2 to 3.3.2
• Updated com.exasol:udf-debugging-java:0.5.0 to 0.6.1
• Updated com.exasol:virtual-schema-common-document-files:6.0.1 to 7.0.2
• Removed junit:junit:4.13.2
• Updated org.jacoco:org.jacoco.agent:0.8.5 to 0.8.8
• Removed org.jacoco:org.jacoco.core:0.8.7
• Updated org.mockito:mockito-core:4.1.0 to 4.6.1
• Updated org.testcontainers:junit-jupiter:1.16.2 to 1.17.2
• Updated org.testcontainers:localstack:1.16.2 to 1.17.2
• Updated org.yaml:snakeyaml:1.29 to 1.30

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:0.7.1 to 1.1.1
• Updated com.exasol:project-keeper-maven-plugin:2.0.0 to 2.4.6
• Updated org.apache.maven.plugins:maven-compiler-plugin:3.8.1 to 3.10.1
• Updated org.apache.maven.plugins:maven-dependency-plugin:3.2.0 to 3.3.0
• Updated org.apache.maven.plugins:maven-jar-plugin:3.2.0 to 3.2.2
• Updated org.codehaus.mojo:versions-maven-plugin:2.8.1 to 2.10.0
• Updated org.jacoco:jacoco-maven-plugin:0.8.7 to 0.8.8
• Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
• Updated org.sonatype.ossindex.maven:ossindex-maven-plugin:3.1.0 to 3.2.0