Skip to content

Support OctoAI (no streaming) #34

Support OctoAI (no streaming)

Support OctoAI (no streaming) #34

Workflow file for this run

name: Test with Node.js
on: [push, pull_request]
jobs:
test:
runs-on: ubuntu-22.04
timeout-minutes: 10
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: '18'
- name: Prepare LLM (Phi-3 Mini)
uses: ./.github/actions/prepare-llm
timeout-minutes: 3
- run: echo 'Which planet in our solar system is the largest?' | ./ask-llm.js | grep -i jupiter
timeout-minutes: 7
env:
LLM_API_BASE_URL: 'http://127.0.0.1:8080/v1'
LLM_DEBUG: 1