>>106616071
Just tried using mistral_common, but it seems to have issues with how SillyTavern is sending parameters and I don't have patience for this shit.
ValueError: Invalid parameters passed to `ChatCompletionRequest.from_openai`:
OpenAI valid parameters but not in `ChatCompletionRequest`: {'stream', 'frequency_penalty', 'presence_penalty'}
Non valid parameters: set()