So, a couple years ago, i found something called AI dungeon, it was my first contact with an AI model. It was very good until it got censored af. The version i used was probably using GPT 2 or 1 (idk)
Is there any model that can compare or is better for text based RPGS that isn’t very censored and preferably 7b (im running on oobagooba with my CPU)
Note: Sorry if i used the wrong terminology, I’m still a total noob lol. I discovered you can run your own language model just 2 days ago, and don’t worry, I’m not trying to fulfill some weird fetish 💀.
You might like this if you’re looking to go a bit beyond AI dungeon.
I’m working on something similar, but different: https://github.com/neph1/LlamaTale
It will never allow the kind of freedom that a pure storytelling model will give you. But the goal is to provide a more stable experience. I’ve made a number of posts about it here (and the next one is due, soon), but here’s the first:
https://www.reddit.com/r/LocalLLaMA/comments/152w71n/mud_llm_for_a_stronger_roleplaying_experience/
It runs fairly well with a 7b, https://huggingface.co/TokenBender/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged being the one I play with, mostly.
Goliath 120B. The best model for Role-playing (for my usecase: mostly interactive fiction/RPG) that I’ve ever used till date. https://huggingface.co/alpindale/goliath-120b
I have a dungeon crawl character card that always just keeps my “inventory” in a list after the narration on every prompt, but the model I use might be too heavy since I use a dual 3090 setup, Dolphin 2.2 70B.
Damnnn that’s a sick setup, btw how can i get these characters?
Llama2 base model can do it reasonably well.
Here is a good comparison: https://www.reddit.com/r/LocalLLaMA/comments/17kpyd2/huge_llm_comparisontest_part_ii_7b20b_roleplay/
Basically you should try OpenHermes-2-Mistral-7B or LLaMA2-13B-Tiefighter-GGUF
u/MostlyRocketScience has some good recommendations (I myself had a lot of fun asking OpenHermes 2.5 to start text adventures, though it has a habit of going on unless you set the generation length to 200 or lower).
If you mean recreating AI Dungeon literally, there’s Dan’s Adventurous Winds 7B (based off of the well-received 7B “Mistral” models), which has been trained on text adventure datasets.
There’s also these which were trained on the original AI Dungeon dataset (which was pretty unhinged), but they aren’t the same size you’re looking for:
-
AI Dungeon 2 Classic (1.5B, the original GPT-2 model; to run it under Oobabooga you need to use the “ctransformers” loader)
-
Spring Dragon (13B, intended to replicate AI Dungeon’s paid GPT-3 model from 2020)
Any reason for Kobold instead of Ooba+SillyTavern?
-