Clairvoyance and Local Models

Local Models does not work Win11 latest version

from Stardock Forums

Aug 21, downloaded latest Clairovoyance. I have local models working with Ollama (in chat window) and with AnythingLLM. Win 11. I have a RTx5090 card 24gb RAM, very good setup. But the program says it cannot detect a local model setup. I have it working otherwise. 

Moved to Clairvoyance area

Stardock Software Type: Bug Report
284 views 3 replies
Reply #1 from Stardock Forums Top

Hello,

Sorry to hear you are having issues. I have forwarded your problem/question to Stardock Support Team for their assistance. Please keep an eye on this thread for any updates. We appreciate your feedback and patience. Thank you.

Basj,

Stardock Community  Assistant

Reply #2 from Stardock Forums Top

Do you happen to have Ollama installed as well? I'm wondering if we can isolate it to if it's the Anything LLM not working with CV or a model issue perhaps.

Siege of Centauri
Reply #3 from Stardock Forums Top

i had Ollama installed. But good news is that the next update fixed it. Local model detected. My local gpu is turning out not to be good enough for coding work, etc. But I will explore using it for all the assistance work. While it was about as big a local GPU as you could get on a Windows laptop, it could still only hold a modest token window (say16k), compared to running a Claude session with a 1million token window. But for these local aspects Clairovoyance will hopefully be helpful.