GPT4All is easy for anyone to install and use. It allows you to download from a selection of ggml GPT models curated by GPT4All and provides a native GUI chat interface. Hardware CPU: Any cpu will work but the more cores and mhz per core the better. RAM: Varies by model requiring up to 16GB Installation GUI installer works out of the box on Ubuntu and then you just double-click the icon on your desktop. wget 'https://gpt4all.io/installers/gpt4all-installer-linux.run' chmod +x './gpt4all-...
I loved this however my only disappointment is that you can’t use it as a server others can connect to and use the chat interface
Use this webui (its the stabld diffusion ui for llm)
https://github.com/oobabooga/text-generation-webui
I am pretty sure it has a sever option.
Here is a list of the models it likely supports, including gpt4all. https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Best one i tried is wizard vicuna 13B running on a rtx2070
oh hey this is super useful, thanks! :D
It does have an API server so you should be able to do just that. Haven’t tried it though.