v2.6.4 – Ghost messages

Dev Log
← Back to Dev Log

Plugin store is now part of the app. Ghost messages are a powerful backend solution to using spices with cache. AKA spices don’t cost a fortune with prompt caching. Ghost messages slip in a message between the user and AI message. The ghost message is not visible to the user, and is only visible to the AI as it types the message, then it ghosts away, not in the logs. Ghost messages can invisibly steer the AI. Use your imagination, this feature already tested, has extreme power on AI responses. Oh and Dashboard has widgets you can make more with plugins.

I should have just made this 2.7.0 but I just didn’t feel like big numbers this time. No good reason.