Add stop sequence parameter for controlled generation

[Itinte]

Description:

It would be valuable to include a stop sequence parameter in the API client to facilitate controlled generation termination.

Reference Implementation:
Referencing OpenAI's implementation, please check: OpenAI API Reference - Chat Create Stop

Use Case:
This feature becomes crucial when working with agents, allowing users to halt generation at precise steps

discord topic

[sbarman-mi9]

I second this. It's much needed.

[yquemener]

Adding to this. For now that limits my usage of Mistral API. I have tons of requests to do with very short yes/no answers. For now local hosting is my only solution sadly (and I can't try medium on my workload).

[failable]

Any updates?