Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Hive Metastore 4.x and see if we can archive my HMS image #43

Open
bitsondatadev opened this issue Mar 28, 2024 · 3 comments
Open

Comments

@bitsondatadev
Copy link
Owner

          Looks like this fixed the issue.

#38 (comment)

Any reason why this wasn't used instead of custom HMS + psql?

There were some oddities about earlier HMS images in 3.x. If the latest 4.x metastore has those worked out then I would love to get rid of my HMS Docker image.

I'll open a new Issue to remind myself to look at that later.

Originally posted by @bitsondatadev in #38 (comment)

@bitsondatadev
Copy link
Owner Author

The only recent thing I remember we added quickly to this was the ability to run on an M1 processor, but I'm hopeful this is resolved in the latest.

@metadaddy
Copy link
Contributor

Hi @bitsondatadev - this works for me in the trino-b2 tutorial:

  hive-metastore:
    image: 'apache/hive:4.0.0'
    hostname: hive-metastore
    ports:
      - '9083:9083' # Metastore Thrift
    volumes:
      - ./conf/core-site.xml:/opt/hadoop/etc/hadoop/core-site.xml:ro
      - ./conf/metastore-site.xml:/opt/apache-hive-metastore-4.0.0-bin/conf/metastore-site.xml:ro
    environment:
      SERVICE_NAME: metastore
      METASTORE_DB_HOSTNAME: mariadb
      HIVE_AUX_JARS_PATH: /opt/hadoop/share/hadoop/tools/lib/hadoop-aws-3.3.6.jar:/opt/hadoop/share/hadoop/tools/lib/aws-java-sdk-bundle-1.12.367.jar
    depends_on:
      - mariadb
    networks:
      - trino-network

There may be more optimal ways to do this, but a few hours of trial and error led me here.

@metadaddy
Copy link
Contributor

See #50

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants