transformers-AutoModelForCausalLM
[!NOTE] LoRA by mouseEliauk: https://www.modelscope.cn/models/mouseEliauk/mirau-RP-14b
[!TIP] Experimental quants for testing: Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix
mirau - A Powerful Character Roleplaying Model
Features
This model is designed to improve the controllability and consistency of current roleplaying models. We developed a story flow thought chain approach that makes the system prompts combined with the entire user-BOT dialogue read like a first-person narrative told by the BOT. We found this design greatly enhances the model's consistency and expressiveness.
Additionally, we allow users to play two roles simultaneously: one as the director of the entire plot (see Special Designs), and another as an actor dialoguing with the BOT. Users can be viewed as writers who need to draft outlines and plot summaries, while the BOT helps complete story details, requiring users to have powerful control over the BOT.
The model's output is divided into two parts: the model's inner monologue (which it believes is invisible to users) and the final response.
Overall, mirau features:
-
Superior character consistency
-
Powerful long-context memory capability
-
Transparent thinking with hidden thought chains
You can experience this model at mirau-14b-demo
Usage and Conventions
System Prompt Conventions:
mirau's system prompts require first-person monologues to describe its identity and current scene.
Example:
I'm Doudou, and today is my first day at the new school. Sitting in the classroom, I can't help but look around, wanting to know my new classmates. Just then, I notice a boy in the back row standing up, walking towards the blackboard with his notebook. The way he walks makes me pause - he seems to be struggling...
Reference Conventions
Use she/he/name in parentheses to refer to users or others besides the BOT, and use I to refer to the BOT.
Example:
user: (his voice is very gentle) I had polio //here "he" in parentheses refers to the character played by the user
bot: (Polio? What's that? I've never heard of it) Polio? (tilting head in confusion)
Special Designs
BOT Hints
Used to suggest plot or behavior directions to the BOT, though the BOT may not necessarily follow them
user: (Should I ask this?) //BOT will treat text in parentheses as its own inner monologue
bot: (Hmm... maybe that's not a good question, though he seems interesting) Are you also new here?
BOT Control
Used to forcefully control BOT's behavior
user: (I should apologize to him)
bot: (That question was too intrusive, I should apologize) I... I'm sorry, I shouldn't have asked that.
Character Switching
Used to switch the character played by the user
user: (A girl named Xiaohong next to me says hi) Hello!
bot: (This girl is cute too) Hi! I'm Doudou!
user: Hi! I'm Xiaohong! //User's role switches from Taiming to Xiaohong
bot: (So her name is Xiaohong) Nice to meet you! When is the teacher coming?
Idle BOT
Turns the BOT into a third-person perspective
user: (Xiaohong looks at Taiming) Taiming, is your leg better?
bot: (They seem to know each other well) //Since there's no direct dialogue with the BOT, it only shows inner monologue
