Skip to content

Issues: shikras/shikra

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

40 Open 21 Closed
40 Open 21 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How to implement cross-modal referencing?
#62 opened Mar 25, 2024 by hzdzkjdxyjs
1
Can the LLama model here be replaced with GPT-4?
#61 opened Mar 15, 2024 by PlutoXN
Custom Dataset Creation
#60 opened Mar 3, 2024 by imr555
train on a single dataset
#59 opened Jan 16, 2024 by CYF2000127
1
When I run the example in the demo, I get the error.
#58 opened Jan 4, 2024 by qinbaigao
Requirements for the demo
#56 opened Jan 1, 2024 by roy651
When I was creating a demo using "Python mllm/demo/webdemo. py -- model_path/path/to/shikra/ckpt", the following error occurred.
#55 opened Dec 4, 2023 by yubo97
4
TypeError: Image.__init__() got an unexpected keyword argument 'source'
#54 opened Nov 14, 2023 by WANGSHAOXIA11
2
question about detection
#53 opened Nov 14, 2023 by an1018
How to make the model accurately output the dimensions of bbox and point
#52 opened Oct 29, 2023 by ImmortalSdm
training detail
#51 opened Oct 19, 2023 by yeonju7kim
1
Wrong output when the inference stage
#50 opened Oct 18, 2023 by Yiveen
1
Inconsistent performance on REC task
#49 opened Oct 13, 2023 by ZhanYang-nwpu
4
Could you share your prompt or code to generate QA data from GPT4
#48 opened Sep 12, 2023 by double-fire-0
training on 8 V100 is too slow, shikra_pretrain_final19_stage2 nearly 800h。 Does anyone have a similar situation?
#47 opened Sep 7, 2023 by Anymake
I have collected the download addresses for all the training data and posted them here for others to download conveniently.
#46 opened Sep 7, 2023 by Anymake
2
About accelerate config
#45 opened Aug 24, 2023 by jun0wanan
Inconsistent performance on MMBench
#44 opened Aug 23, 2023 by scenarios
1
it seems like you use llava model, I want to know when training model, do you add the position information like " the cat is at [0.2, 0.2, 0.5, 0.5], or without any position information in training?
#43 opened Aug 23, 2023 by wjfwjfwjf
Question about coordinate numerical representation
#42 opened Aug 22, 2023 by gray311
1
An NCCL RuntimeError occurred when saving the model
#41 opened Aug 21, 2023 by Lanxin1011
Shikra-RD
#40 opened Aug 21, 2023 by yuntaodu
TypeError: cfg should be a dict, ConfigDict or Config, but got <class 'NoneType'>
#38 opened Aug 16, 2023 by hangzeli08
Question about the training parameter setting at stage1 and stage2
#37 opened Aug 9, 2023 by Lanxin1011
3
Evaluation on PointQA, VQAv2, OK-VQA and Captioning
#36 opened Aug 9, 2023 by ShramanPramanick
3
ProTip! Type g i on any issue or pull request to go back to the issue listing page.