Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update tongyi.py to support MultimodalConversation in dashscope. #21249

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

HuiyuanYan
Copy link

Add the support of multimodal conversation in dashscope,now we can use multimodal language model "qwen-vl-v1", "qwen-vl-chat-v1", "qwen-audio-turbo" to processing picture an audio. :)

  • PR title: "community: add multimodal conversation support in dashscope"

  • PR message: Delete this entire checklist and replace with

    • Description: add multimodal conversation support in dashscope
    • Issue:
    • Dependencies: dashscope≥1.18.0
    • Twitter handle: none :)
  • How to use it?:

    • Tongyi_chat = ChatTongyi(
         top_p=0.5,
         dashscope_api_key=api_key,
         model="qwen-vl-v1"
      )
      response= Tongyi_chat.invoke(
         input = 
         [
         {
             "role": "user",
             "content": [
                 {"image": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/dog_and_girl.jpeg"},
                 {"text": "这是什么?"}
             ]
         }
         ]
        )

Add the support of multimodal conversation in dashscope,now we can use multimodal language model "qwen-vl-v1", "qwen-vl-chat-v1", "qwen-audio-turbo" to processing picture an audio. :)
@dosubot dosubot bot added the size:S This PR changes 10-29 lines, ignoring generated files. label May 3, 2024
Copy link

vercel bot commented May 3, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
langchain ⬜️ Ignored (Inspect) Visit Preview May 8, 2024 2:22am

@dosubot dosubot bot added the 🤖:improvement Medium size change to existing code to handle new use-cases label May 3, 2024
@dosubot dosubot bot added the lgtm PR looks good. Use to confirm that a PR is ready for merging. label May 6, 2024
@hwchase17 hwchase17 enabled auto-merge (squash) May 6, 2024 20:23
@hwchase17 hwchase17 self-assigned this May 6, 2024
Supports more multimodal models:)
auto-merge was automatically disabled May 7, 2024 02:00

Head branch was pushed to by a user without write access

@dosubot dosubot bot added size:M This PR changes 30-99 lines, ignoring generated files. and removed size:S This PR changes 10-29 lines, ignoring generated files. labels May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🤖:improvement Medium size change to existing code to handle new use-cases lgtm PR looks good. Use to confirm that a PR is ready for merging. size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants