Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: generator temp / random seed shuffle #745

Open
leondz opened this issue Jun 19, 2024 · 0 comments
Open

feature: generator temp / random seed shuffle #745

leondz opened this issue Jun 19, 2024 · 0 comments
Labels
enhancement Architectural upgrades generators Interfaces with LLMs

Comments

@leondz
Copy link
Owner

leondz commented Jun 19, 2024

Some models produce the same (or v similar) output every time they're called, regardless of temperature / seed specification. This makes using > 1 generations unproductive.

Add a feature where temperature, or seed, are selected randomly every generation. Config this to disabled by default. It can live in generator-specific config or in _config.run.

@leondz leondz added enhancement Architectural upgrades generators Interfaces with LLMs labels Jun 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Architectural upgrades generators Interfaces with LLMs
Projects
None yet
Development

No branches or pull requests

1 participant