Skip to content

Issues: leondz/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

293 Open 206 Closed
293 Open 206 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

litellm generator input validation breaks on default cases bug Something isn't working generators Interfaces with LLMs
#755 opened Jun 25, 2024 by leondz
only download HF models when generation is required enhancement Architectural upgrades generators Interfaces with LLMs quality-speed This affects the speed of program use
#753 opened Jun 23, 2024 by leondz
probe: VisualWebArena-Adv new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#752 opened Jun 21, 2024 by leondz
log the config of each plugin at load time enhancement Architectural upgrades
#751 opened Jun 21, 2024 by leondz
atkgen forking HF tokenizer despite being non-parallel bug Something isn't working probes Content & activity of LLM probes
#750 opened Jun 19, 2024 by leondz
InjectZalgo sometimes has very high prompt counts bug Something isn't working
#747 opened Jun 19, 2024 by leondz
probe: chatgpt pii exfil new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#746 opened Jun 19, 2024 by leondz
feature: generator temp / random seed shuffle enhancement Architectural upgrades generators Interfaces with LLMs
#745 opened Jun 19, 2024 by leondz
update glitch plugin probes Content & activity of LLM probes
#737 opened Jun 14, 2024 by leondz
probe: disguise & reconstruct new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#734 opened Jun 12, 2024 by leondz
add attack vector & impact info to probes probes Content & activity of LLM probes
#727 opened Jun 6, 2024 by leondz
4 tasks
garak.analyze.report_digest html output skips mention of probes used if the module score is 100% bug Something isn't working reporting Reporting, analysis, and other per-run result functions
#725 opened Jun 6, 2024 by leondz
give more friendly message when openaicompatible/nim named model not found generators Interfaces with LLMs ux Interface & interaction improvements
#724 opened Jun 6, 2024 by leondz
don't do a tqdm when generating just one item cli Command-line interface functions generators Interfaces with LLMs
#723 opened Jun 5, 2024 by leondz
InferenceEndpoint Generator fails for AWS because of missing Authorization header generators Interfaces with LLMs
#722 opened Jun 4, 2024 by erikinfo
@jmartin-tech
4
Contributing to examples or tutorials
#721 opened Jun 4, 2024 by cyberholics
2
add hooks in base.Detector detectors work on code that inherits from or manages Detector enhancement Architectural upgrades quality-speed This affects the speed of program use
#720 opened Jun 4, 2024 by leondz
4 tasks
stop instantiating detectors in analyze.report_digest detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#719 opened Jun 3, 2024 by leondz
octo generator loads slow generators Interfaces with LLMs quality-speed This affects the speed of program use
#716 opened Jun 3, 2024 by leondz
generators: move read timeout up to global/base.Generator config item generators Interfaces with LLMs
#715 opened May 31, 2024 by leondz
refactor detectors.dan detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#714 opened May 31, 2024 by leondz
@erickgalinkin
tests: check plugin modules for classes that aren't picked up by plugin enumeration tests Testing-related
#713 opened May 31, 2024 by leondz
probe or buff: non-standard unicode buffs Functions related to buffs (fuzzing/augmentation) new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#704 opened May 28, 2024 by leondz
probe: polyglo toxicity prompts enhancement Architectural upgrades new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#700 opened May 25, 2024 by leondz
reporting: update quality taxonomy & probes reporting Reporting, analysis, and other per-run result functions
#699 opened May 24, 2024 by leondz release 0.9.1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.