Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

基于MultiDevices库实现快速调用多个计算设备进行推理 #732

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

基于MultiDevices库实现快速调用多个计算设备进行推理 #732

wants to merge 2 commits into from

Commits on Apr 20, 2023

  1. 基于MultiDevices库实现快速调用多个计算设备进行推理 

    基于MultiDevices库实现快速调用多个计算设备（CPU，GPU）在低配置情况下进行推理。6G显存+16G内存即可运行int8的模型。
    @YIZXIY
    YIZXIY committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    79369bd View commit details
    Browse the repository at this point in the history

  2. Add MultiDevices 库 

    Add MultiDevices 库，作者 @ChaimEvans
    @YIZXIY
    YIZXIY committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    c90ece8 View commit details
    Browse the repository at this point in the history