Open Source Model Support

[aleksanderrisilia]

Support of locally hosted models

[dreameral]

My first thought after I got "429 You exceeded your current quota" from OpenAI. I don't want to have a paid subscription to be able to work with this project. I'd be happy to give this idea a try.

[xharauenea]

We have made a few changes with the help of @dreameral, to add support for ollama and lm-studio which are the main two providers for locally hosted LLM models. If you have any providers please feel free to reopen the discussion.