JSON Mode
This is simply that I want to refactor our logic to use proper JSON modes in Koboldcpp, OpenRouter & WebLLM and get rid of the imperfect solution(s) I have now. I know one function is called approx. attemptToFixJson
.
This will improve results and maybe performance a bit.