Skip to content

LMQL 0.7.1

Compare
Choose a tag to compare
@lbeurerkellner lbeurerkellner released this 12 Oct 13:46
· 124 commits to main since this release

This is a bug fix release, addressing smaller issues with 0.7.

  • Fix issue with distribution clause and inference tracing
  • make 'random' model independent of chunk_size
  • optimize automatic chunk_size selection to reduce the number of LLM calls (max_tokens hinting)
  • support for direct generation based on a list of OpenAI Chat format dictionaries