Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy Script Fails for Example #13

Open
smart-patrol opened this issue Jan 24, 2024 · 1 comment
Open

Deploy Script Fails for Example #13

smart-patrol opened this issue Jan 24, 2024 · 1 comment

Comments

@smart-patrol
Copy link

I am following the ReadMe and using all default settings.

I get the following error after running bash deploy.sh run

Runtime: kubernetes
Processor: graviton
error: error validating "STDIN": error validating data: failed to download openapi: the server has asked for the client to provide credentials; if you choose to ignore these errors, turn validation off with --validate=false
Generating ./app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml ...
error: error validating "app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml": error validating data: failed to download openapi: the server has asked for the client to provide credentials; if you choose to ignore these errors, turn validation off with --validate=false
@dzilbermanvmw
Copy link
Collaborator

Hello @smart-patrol thank you for reporting your issue with our project.
A couple of triage questions: have you been following the README or more comprehensive implementation guidance document: https://aws-solutions-library-samples.github.io/compute/low-latency-high-throughput-inference-on-amazon-eks.html#deploy-the-guidance?
They both describe the same commands but generally, we ran all of them following the 'build-trace-pack-push-deploy-test' workflow as:

./deploy.sh run

Also, can you please attach the generated ./app-bert-base-multilingual-cased-graviton-c7g.4xlarge/bert-base-multilingual-cased-graviton-0.yaml file that fails to deploy? How many Graviton nodes and of what type do you have in your EKS cluster? thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants