Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: add jaxb library no longer bundled with hadoop #688

Merged
merged 2 commits into from
May 21, 2024
Merged

Conversation

adwk67
Copy link
Member

@adwk67 adwk67 commented May 17, 2024

Description

fixes stackabletech/hive-operator#468.

Recent changes to the hadoop image resulted in a missing logging dependency (jackson-module-jaxb-annotations was originally bundler with the hadoop yarn client): this PR adds the missing specific version.
Start-up scripts for hadoop functions check various env-vars, even if the associated modules are never run. To avoid errors with the initialisation of these scripts default values have been set where necessary.

Local testing with repo: docker.stackable.tech/sandbox/yarnless-hive :-

--- PASS: kuttl (1193.36s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/kerberos-s3_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (315.83s)
        --- PASS: kuttl/harness/logging_postgres-12.5.6_hive-3.1.3_openshift-false (167.48s)
        --- PASS: kuttl/harness/orphaned-resources_hive-latest-3.1.3_openshift-false (124.31s)
        --- PASS: kuttl/harness/cluster-operation_hive-latest-3.1.3_openshift-false (75.79s)
        --- PASS: kuttl/harness/resources_hive-3.1.3_openshift-false (41.52s)
        --- PASS: kuttl/harness/smoke_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true (95.33s)
        --- PASS: kuttl/harness/kerberos-hdfs_postgres-12.5.6_hive-3.1.3_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (372.61s)

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes

Tasks

Edit tasklist title
Beta Give feedback Tasklist Tasks, more options

Delete tasklist

Delete tasklist block?
Are you sure? All relationships in this tasklist will be removed.
  1. Changes are OpenShift compatible
    Options
  2. All added packages (via microdnf or otherwise) have a comment on why they are added
    Options
  3. Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
    Options
  4. All packages should have (if available) signatures/hashes verified
    Options
  5. Add an entry to the CHANGELOG.md file
    Options
  6. Integration tests ran successfully
    Options
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

bake --product <product> --image-version <stackable-image-version>
kind load docker-image <image-tagged-with-the-major-version> --name=<name-of-your-test-cluster>

See the output of bake to retrieve the image tag for <image-tagged-with-the-major-version>.

@adwk67 adwk67 self-assigned this May 17, 2024
Copy link
Member

@sbernauer sbernauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for figuring this out!

@adwk67 adwk67 added this pull request to the merge queue May 21, 2024
Merged via the queue into main with commit 801c6a9 May 21, 2024
13 checks passed
@adwk67 adwk67 deleted the fix/hive-jaxb branch May 21, 2024 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

fix: yarn home copied from hdfs builder
2 participants