The model can be run using Hugging Face Transformers if you have a GPU. A faster quantized version of this model is also available. MonadGPT uses the ChatML format with a special system prompt. It is still in an experimental phase and may have conversation, localization, and language issues.
Key takeaways:
- MonadGPT is a finetune of Mistral-Hermes 2 on 11,000 early modern texts in English, French and Latin, and can be used in conversation mode.
- It answers in an historical language and style, using historical and dated references, especially visible for science questions.
- The model can be run using Hugging Face Transformers if you have a GPU, or a faster quantized version can be run using llama.cpp.
- MonadGPT is still in an experimental phase and may have conversation, localization, and language issues.