Yes, databases (saved on a hard drive). SillyTavern has Smart Context but that seems not that easy to install so I have no idea how well that actually works in practice yet.

I honestly have no idea what you’re referring to now. I never asked for any ideas.

I was being sarcastic. If you pay for a prostitute you might as well pay for an AI service such as novelai.

And I replied to that comment, without any mouth foaming.

If they’re local they’d be basically useless due to a lack of computing power and potential lack of indexing for a search engine chatbot, so I doubt it. It would also have to be so polished that it wouldn’t require further user knowledge / input, and that’s just not a thing with any local LLM I’ve come across. Mozilla can gladly prove me wrong though. I certainly wouldn’t mind if they generally can make the whole process of local LLMs easier and more viable.

Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.

How are they going to block VPNs?

Kids will do that either way when they get to that age.

It’s honestly stupid. They just go to less moderated sites, or if you’re lucky, learn how to use a VPN and bypass all this nonsense anyway.

Yeah, I heard they’re also very privacy friendly.

America moment.

I don’t know, I’m not a weeb.

All of those could be terrible to be honest, because AI is a data tracking vacuum. An AI adblocker or content filter sounds cool at first, but it would mean it reads and analyzes your data, just like the shit you do with chatbots too. Reading your mails? That’s basically what Google does for years with gmail, that’s why they have such a good spam filter. I agree that a chatbot would be kinda useless though, even if privacy friendly, which in of itself would be great but I just don’t see the use. This could simply be outsourced to a website.

There’s no way it would be running locally.

You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don’t have enough vram for that.

The bots (what the actual girlfriends or whatever other characters are) aren’t the problem. You can find them on chub.ai for example or write them yourself fairly easily. The issue the software, and even more so the hardware. You need something like the mentioned Kobold.ccp or oobabooga, and then you’d also need a trained LLM model that you can get on huggingface.co, which is already where it gets complicated (they’ll be loaded within kobold or oobabooga). You also need to understand how they work in regards to context sizes & bytes, because they need a lot, and I mean A LOT of vram to work properly. Basically, the more vram you have, the better the contextual understanding, their memory is. Otherwise you’d have a bot that maybe knows to only contextualize the last couple messages. For paid services like novelai.net you basically have your bots run through big ass server farms with lots of GPUs that bundle their vram and processing power, giving you “decent” context sizes (imo the greatest weak point of LLMs and it is deeply rooted in how they work) and decent speed. NovelAI also supports front-ends like SillyTavern which is great for local bot management and settings, regardless if you self host or use a paid service (NOT EVERY PAID SERVICE HAS AN API FOR THIS! OpenAI’s ChatGPT technically does too but they do not allow NSFW content and can ban you for that if caught).
There’s a bunch of “free” online services too, like janitorai.com but most of them have slow speeds and the chat degrades significantly after just a few messages, because they have low context sizes. The better / paid models suffer from this degradation too but it is slower and less noticeable, at least at first. You can use that to get an idea of how LLMs work though.

Edit: Should technically self explanatory / common sense, but I would advise not to share ANY personal information through online service chats that could identify you as a person!

Seems to be librist that’s the issue here. The nobara-amdgpu-config package issue also errors out on the first command though, skipping a package.

Problem: cannot install the best update candidate for package pipewire-codec-aptx-0.3.69-1.fc38.x86_64

• nothing provides pipewire >= 1.0.1 needed by pipewire-codec-aptx-1.0.1-1.fc38.x86_64 from rpmfusion-free-updates

This also happened on the following nobara-sync command. And the second command gives:

error: package nobara-amdgpu-config is not installed

Went through with it anyway but I feel that’s potentially one of those things that eventually causes issues further down the line until the system doesn’t boot anymore…

I already fail at the first one:

sudo dnf remove -y blender discord telegram-desktop oneapi-level-zero librist libndi-sdk firefox onlyoffice-desktopeditors

Which errors out:

Error:
Problem: The operation would result in removing the following protected packages: plasma-desktop
(try to add ‘–skip-broken’ to skip uninstallable packages)

Does it support mbin instances too?

Using a Chrome user agent in FF can result in broken video / audio playback on various sites.