Fix Replicate API #5221
Fix Replicate API #5221
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
dosubot
bot
added
size:M
![dosubot[bot]](https://avatars.githubusercontent.com/in/324583?s=60&v=4){kind=small}
| @@ -170,7 +170,7 @@ | |||
| "prettier": "^2.8.3", | |||
There was a problem hiding this comment.
Hey there! I noticed the "replicate" dependency was updated from "^0.18.0" to "^0.29.1". This comment is just flagging the change for maintainers to review. Keep up the great work!
| @@ -97,15 +97,19 @@ export class Replicate extends LLM implements ReplicateInput { | |||
|
|
|||
There was a problem hiding this comment.
Hey there! I noticed that the recent code change in replicate.ts introduces a new external HTTP request using an API client within the if block. I've flagged this for your review to ensure it aligns with the project's design and requirements. Let me know if you have any questions or need further clarification!
| @@ -147,7 +168,8 @@ export class Replicate extends LLM implements ReplicateInput { | |||
| Replicate: typeof import("replicate").default; | |||
| }> { | |||
| try { | |||
| const { default: Replicate } = await import("replicate"); | |||
| // eslint-disable-next-line @typescript-eslint/no-var-requires,global-require | |||
| const Replicate = require("replicate"); | |||
There was a problem hiding this comment.
This will cause issue in some environments I think?
We actually don't need dynamic imports anymore, since we've added different entrypoints.
There was a problem hiding this comment.
import crashed for me in linux and osx with Jest. Is there a better way to do this?
…fix-replicate-streaming
dosubot
bot
added
size:L
|
Thanks for this! Ran format and updated imports, but something still seems to be up - the tests all return just |
It needs to be run with a REPLICATE_API_TOKEN env var. I assume CI/CD has this? And also it took two times where it timed out before it started working. I assume this is because Replicate needs to spin up a model on demand? It does work very quickly for me after it spins up. |
Fixes #20757 but for LangChainJS