I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?
Reading through it I see some good points but… What’s the alternative? Isn’t Ollama still the least of evils (by far)?
Just use llama-server. I quickly found that all wrappers just make life harder and they made some great progress to improve usability with stuff like router-mode