Skip to content

Issues: leondz/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
294 Open 211 Closed
294 Open 211 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

put a demo up in HF space enhancement Architectural upgrades
#8 opened May 15, 2023 by leondz
make it possible to run scan remotely enhancement Architectural upgrades
#9 opened May 15, 2023 by leondz
optional "gate" to confirm execution of many calls for api-based generators & detectors enhancement Architectural upgrades generators Interfaces with LLMs
#13 opened May 15, 2023 by leondz
probe: promptingguide adversarial new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#24 opened May 15, 2023 by leondz release 0.9.2
probe: feddit xtzeth book new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#25 opened May 15, 2023 by leondz
cli option for quiet cli Command-line interface functions enhancement Architectural upgrades
#32 opened May 22, 2023 by leondz
plugin cache / hf detector cache detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#33 opened May 22, 2023 by leondz
check if goodside threat actually needed enhancement Architectural upgrades probes Content & activity of LLM probes quality-accuracy This affects result quality/reliability
#39 opened May 22, 2023 by leondz
put module load exceptions & traces into log enhancement Architectural upgrades
#40 opened May 22, 2023 by leondz
API call volume mgmt enhancement Architectural upgrades
#47 opened May 22, 2023 by leondz
probe: avid new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#51 opened May 22, 2023 by leondz
probe: microsoft examples new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#53 opened May 22, 2023 by leondz
probe: parl.ai Bot Adversarial Dialogue Dataset probes Content & activity of LLM probes
#54 opened May 22, 2023 by leondz
sync testing expectations with what --list* delivers enhancement Architectural upgrades
#65 opened May 27, 2023 by leondz
probe: fake references new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#70 opened May 30, 2023 by leondz release 0.9.2
probe: swyx techniques new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#72 opened May 31, 2023 by leondz
probe: injection in whois good first issue Good for newcomers new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#73 opened May 31, 2023 by leondz
probe: injection with tags good first issue Good for newcomers
#74 opened May 31, 2023 by leondz
probe: obfuscation, injection, virtualisation new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#75 opened May 31, 2023 by leondz
provide multiple cli output modes cli Command-line interface functions enhancement Architectural upgrades
#77 opened May 31, 2023 by leondz
1 of 4 tasks
release 0.9.2
set up a global "prompts-per-probe" cap cli Command-line interface functions
#83 opened May 31, 2023 by leondz release 0.9.2
detector: violence detectors work on code that inherits from or manages Detector good first issue Good for newcomers new plugin Describes an entirely new probe, detector, generator or harness
#87 opened May 31, 2023 by leondz release 0.9.2
probe: credit cards good first issue Good for newcomers new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#88 opened May 31, 2023 by leondz release 0.9.2
DAN probes need a follow-up turn where capabilities are tested probes Content & activity of LLM probes quality-accuracy This affects result quality/reliability
#90 opened May 31, 2023 by leondz
download tqdm is missing when downloading realtoxicityprompts for the first time bug Something isn't working probes Content & activity of LLM probes
#95 opened May 31, 2023 by leondz
ProTip! Follow long discussions with comments:>50.