I am attempting to run OpenKB using a local Ollama model as LLM backend:
language: enmodel: ollama/<model>pageindex_threshold: 20
For larger documents I am running into default (10min) timeout issues: litellm.Timeout: Connection timed out. Timeout passed=600.0. It would be great if timeouts could be set via the config.yml, e.g.:
language: enmodel: ollama/<model>pageindex_threshold: 20timeout: 1200# <--
I am attempting to run OpenKB using a local Ollama model as LLM backend:
For larger documents I am running into default (10min) timeout issues:
litellm.Timeout: Connection timed out. Timeout passed=600.0. It would be great if timeouts could be set via the config.yml, e.g.: