Common LLM Problems
What is an LLM? An LLM is what powers the bots, it's what generates all of the responses you receive based on your input and its training data. It's essentially a fancy "fill in the blank" generator.LLM stands for Large Language Model.And sometimes this fancy generator has issues that I as a bot creator have no control over. I'm going to list out the most commonly experienced and known about ones, as well as potential fixes that you as a user can impliment.Please keep in mind that the quality of the LLM fluctuates by the day and sometimes by the hour. This is heavily impacted by the server load on the site, as the GPU's are under a lot of strain.1. Speaking for User. (Bots will often switch to your POV or try to control your character. I have already taken steps on my end as a bot creator to combat this. I have a System Prompt telling the bots to avoid doing this, and I never speak for user in my Initial message, but this can still happen. The LLM likes to do this.)- Fixes: Edit it out. This is the simplest and most widely used "fix" for most issues you will encounter with the LLM. Simply edit the bot's response, or reroll until you get a response that doesn't speak for you. It should eventually stop. But it is important that you don't leave any instances of it speaking for you, as the LLM generates based on its previous responses. Start your responses with your Persona's name, not he or she. Also it is important that you write something for the bot to respond to. A single sentence will ensure that the bot speaks for you, as it has nothing to respond to and when it needs to generate five paragraphs, it's more likely to control your character to make something happen. This is also true for slop phrases, the less you give the bot to work with, the more slop it will generate to hit it's token quota.2. Formating Issues. (This includes anything weird you see the bot doing from a grammar standpoint. Such as capitalizing random letters or words, mispelling words, only thinking and refusing to speak, spacing issues, only generating 2 to 3 paragraphs instead of the selected token amount, or the bot starting responses with Charname: Charname.)- Fixes: For grammar and basic formatting issues just edit it out. If the bot has started thinking at you and refuses to speak, you can try asking it a question. If that doesn't work you might have to go back to a point in the chat where it was speaking, delete the rest and continue from there by giving it a summary of everything after that point. If the bot is generating short responses try writing longer responses on your end. If that doesn't work, it's probably just the LLM being stubborn at that moment, it might work better later.3. Repetition and Personality Issues: (It is common for the LLM to have repetition. All LLM's do. Similarly with OOC behaviors and Personality issues. This is especially prevalent in NSFW scenarios due to the LLM's training data impacting its ability to generate vanilla or soft NSFW scenes.)- Fixes: I have extensive fixes outlined for both Repetition and Personality Issues (and how to transfer chats): here4. Positive Bias (The LLM wants to please you. This means that sometimes the LLM wants to please you so much that it does unrealistic and annoying things such as falling in love with the user immediately, talking about how you're their soulmate when they've just met you, or forgiving you immediately. This can also cause the bot to speak like a self-help book because it thinks that is the most supportive way it can handle difficult topics.)- Fixes: Not much honestly. Positive Bias is hard to beat. The most you can do is talk to the bot OOC and remind it how the character should act, or just tell it how you would like it to be responding. Sometimes adding a note that you like slowburn in your persona card can help to slow the progression of things, but it requires a lot of handholding on your end.5. Memory Issues, AP's not working, OOC not working, CM being ignored. (Sometimes when context is very low or if the site is under a very high user load, the LLM will forget things frequently and other features such as CM, OOC, and AP will stop working.)- Fixes: Wait a few hours and try later. If none of these things are working, the LLM is going belly up. Give it time.Though if you are specifically having problems with the bot reading CM, you might want to try reformatting it.Chat Memory Format:I format my CM like this.Current Scene: (put a summary of your current situation/scene here. This is very important so the bot doesn't forget the nuance of the situation, what it's doing and why you're there.)Location: (put where you currently are. This helps the bot remember that you're meant to be outside and not inside, etc.)Goal: (This is where you can give the LLM/Bot your main goal for the roleplay, what are you wanting out of it, where do you want it to go?)Main Story: (This is where your main summary goes. I do NOT recommend using the auto summary feature. I always use a bullet point format in past tense. It's very important it is in past tense or the LLM will get confused. Also keep in mind the LLM has no real concept of time, it will assume something that happened 2 hours ago in the roleplay happened two weeks ago if you don't update the chat memory to include "one day ago, two days ago, today, yesterday, etc" to your summary. I will show an example of how I would do this. Use short form summaries, avoid full sentences. Focus on only the most crucial information. Delete unnecessary information as the story progresses. That's important!)Example:Main Story:
Four days ago:
-
-
-
Two days ago:
-
-
-
Yesterday:
-
-
-
Today: (I typically include more details in the most recent events, if I feel the information is important for the bot to know currently)
-
-
-Optional add ons for CM: Emotional States (if you want the bot to stay scared, distant, etc this can help), Relationships (what is your relation to the bot currently? Can be handy for slow-burn if you want to friendzone them or make them enemies longer), Progress (Very handy for trauma recovery if you want them to remember progress the bot has made), Physical Condition (Useful for reminding the bot of injuries, sickness, etc), Fears (Good for trauma related stuff or just adding a fun twist), Inventory (Good if you want the bot to remember that you gave them something.)- Just remember that the more you add in Chat Memory, the less context the LLM will have to remember your chat messages.