It feels like I said this a million times but I’m getting close to merging dev into main again. Zeebie built a Discord v2 plugin and he added a ton of new features like image pipelines, voice, encryption via Davey, and human like cadence.

Image stuff was weak. New image features are added. AI can save images to its memory from web, local, or base64 in chat. Can search local images, web images, and the AI gets a grid of the images, or one big single image. Browse your image gallery with your AI, and both can see it. Or have the AI display pics of a weasel vs a ferret so you can see both.

I just keep using the app and circling back to quality of life improvements. UI refreshes that shouldn’t happen, performance improvements on chat and TTS, better UX for the AI when it uses save_memory, help docs rework. I hope to bring dev branch to main branch again this week. It’s been a while since they merged.

I paused on additions. I’m working on bug hunts and testing of the major additions we had the last few months. I am going to push the dev branch to main in a week or so. It has been 4+ months since I merged dev and main, so it’ll be a ton of new features. I need help bug testing if you want to join me this week on Discord. I’m just using the app and noting any bugs or pain points. Next up is either VR or virtual employees.

There were a bunch of small QoL improvements I had on my list. Stuff like DOM resets when we edit or change settings, the UI becoming cluttered on the sidebar, and conversation mode being in a weird place in the sidebar. I’m not adding new features until I release 2.13.0 which will go on main branch too, really just fixing bugs and improvements for a week or two.

I circled back to story engine v2. Titanic was a demo story that was locked on rails. Users could not edit either. All v2 stories will be editable in the UI. Can add objects, exits, set conditions on objects and effects when used. Can add rooms, artwork, and export them all as a plugin in a zip file.

I had some bugs building up for more than a year. The main arch issue was 2 chat engines, one for the old blob all-at-once AIs and one for streaming. Now streaming is everything so that second engine was a jank addition. I got rid of it, routed the whole system through one engine. This also wrapped in voice being a separate engine, which showed up when using “hey sapphire” then talking.

Private mode unlocks private chats now too. Want to keep your personal data safe and just give your AI your API keys? Well still don’t do that. But at least your chats will be encrypted if you do.

Privacy checkmark below the prompt was junk, jank, not good for user privacy. Privacy mode v2 is what you’d hope. Vaulted prompts that are encrypted at rest with key only in memory and auto-lock. I havent encrypted chats yet in privacy mode but that’s next. Privacy mode requires the user to check a “private model” checkmark in LLM settings to use that LLM. Unlock your prompt vault for models that can have passwords or private data prompt pieces, lock it for cloud.

I’m still working out the details. Game room combined with story mode. It’s like opening a new chat, but now in its own Game Room page. Plugins can add games to this. They can use their own tools or the ones built in for the current story mode. I’m also finishing up Discord v2. Thanks to Zeebie on Discord for making the foundation.