So far I have tried to get it to read me my shoping list, turn on my desklight, and tell me how many hours until sundown. It wasn’t able to do any of those things. I’m using llama3.1:8b. I have a 3080 12gb. I also tried mixtral:8x7b but it just says “unexpected intent error”.
I think you’re gonna need to implement function calling in some way. If you add it yourself that’s kinda complicated to implement in a non-annoying way but there must be some assistant frameworks that you can connect with your local LLM instead of an external API