Skip to content

JSON Mode

This is simply that I want to refactor our logic to use proper JSON modes in Koboldcpp, OpenRouter & WebLLM and get rid of the imperfect solution(s) I have now. I know one function is called approx. attemptToFixJson.

This will improve results and maybe performance a bit.