Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ver 2.6 only support english? #60

Closed
selfboot opened this issue Jun 15, 2023 · 10 comments
Closed

Ver 2.6 only support english? #60

selfboot opened this issue Jun 15, 2023 · 10 comments
Assignees
Labels
bug Something isn't working

Comments

@selfboot
Copy link

/language chinese seems not work, it replied:

对不起,虽然我理解并会说中文,但是作为Mr. Ranedeer,我目前只能使用英语。这是因为在执行和理解Mr. Ranedeer的所有功能和指令时,我必须使用英语。对此不便,我深表歉意。

chat link

@JushBJJ
Copy link
Owner

JushBJJ commented Jun 15, 2023

Yikes the language bug is back again 😬

@JushBJJ JushBJJ self-assigned this Jun 15, 2023
@JushBJJ JushBJJ added the bug Something isn't working label Jun 15, 2023
@selfboot
Copy link
Author

Yikes the language bug is back again 😬

I read the prompt, and cannot understand why GPT4 refuses to respond in other language.

You said "again", have you encountered this bug before? How was it solved last time?

@JushBJJ
Copy link
Owner

JushBJJ commented Jun 15, 2023

Yikes the language bug is back again 😬

I read the prompt, and cannot understand why GPT4 refuses to respond in other language.

You said "again", have you encountered this bug before? How was it solved last time?

In v2.5 I added there was an overall rule section that had You are allowed to change your language to any language that is configured by the student. because some Chinese users were having problem trying to change their language. I relocated that specific sentence in this version under the commands header.

Perhaps it should be moved somewhere else? Like function rules or student configurations headers? Or maybe re-add the Rules header into the prompt for the tutor's overall behavior.

@selfboot
Copy link
Author

By the way, I have to mention that your prompt is the strangest one I've ever seen. It looks a bit like a program. I really don't know how you came up with this "incantations". Can you share your inspiration?

@JushBJJ
Copy link
Owner

JushBJJ commented Jun 15, 2023

By the way, I have to mention that your prompt is the strangest one I've ever seen. It looks a bit like a program. I really don't know how you came up with this "incantations". Can you share your inspiration?

v2 - v2.5 prompt structure was originally JSON (and optionally other formats), it was out of curiosity, and I wanted a more organized way of creating prompts than a bunch of blob text. v2.6 changed to a custom format for token reduction to allow more features, and a more flexible way of defining things. It was getting quite messy developing in JSON format.

Essentially, I'm trying to act prompting as if it's a hyperflexible programming language. It's quite hard though.

@JushBJJ JushBJJ pinned this issue Jun 15, 2023
@JushBJJ
Copy link
Owner

JushBJJ commented Jun 15, 2023

@selfboot Can you test v2.6.1 and see if the /language command works now?
https://github.com/JushBJJ/Mr.-Ranedeer-AI-Tutor/blob/testing/v2.6.1/

@EncodeTS
Copy link

@selfboot Can you test v2.6.1 and see if the /language command works now? https://github.com/JushBJJ/Mr.-Ranedeer-AI-Tutor/blob/testing/v2.6.1/

I tested it and it now works. Thank you for updating it.

@selfboot
Copy link
Author

@selfboot Can you test v2.6.1 and see if the /language command works now? https://github.com/JushBJJ/Mr.-Ranedeer-AI-Tutor/blob/testing/v2.6.1/

Works fine .
image

And the prompt main diff :

企业微信20230615-151727@2x

@selfboot
Copy link
Author

@selfboot Can you test v2.6.1 and see if the /language command works now? https://github.com/JushBJJ/Mr.-Ranedeer-AI-Tutor/blob/testing/v2.6.1/

Would you consider using evals to evaluate each change of prompt?

@JushBJJ
Copy link
Owner

JushBJJ commented Jun 15, 2023

Thanks for testing, I'll release v2.6.1 soon. Let me know if there are still issues on changing the language.

As for the evals, thanks for bringing it up. I actually completely forgot about it, I'll look into it. Hopefully that will significantly allow the prompt to improve more.

@JushBJJ JushBJJ closed this as completed Jun 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants