README.md

license
other

llama2-13b-megacode2-oasst

• sampling report: 2023-08-15_andreaskoepf_llama2-13b-megacode2-oasst_sampling_noprefix2.json

Prompt template

chatml format is used: "<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"

Multi-line:

<|im_start|>user
{user prompt}<|im_end|>
<|im_start|>assistant
{Assistant answer}<|im_end|>

Credits & Special Thanks

• Compute was generously sponsored by the eplf Machine Learning and Optimization Laboratory
• The open-source epfLLM/Megatron-LLM trainer was used for fine-tuning.
• rombodawg curated and published LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
• andreaskoepf prepared & orchestrated the training.