Skip to content

Issues: JohnSnowLabs/langtest

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

71 Open 358 Closed
71 Open 358 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Explore the DSPy and make integrations ⭐ Feature Indicates new feature requests
#1074 opened Jul 18, 2024 by chakravarthik27
Enhance Harness Report to Include Detailed Score Counts and Grouped Results ⭐ Feature Indicates new feature requests
#1073 opened Jul 18, 2024 by chakravarthik27 2.4.0
Automatic Tests Info Registry with LangTest Versions ⭐ Feature Indicates new feature requests
#1072 opened Jul 18, 2024 by chakravarthik27 2.4.0
@chakravarthik27
Enhance Safety Tests and Develop Comprehensive Safety Test Dataset with Lamaguard 💡Enhancements Something can be improved
#1071 opened Jul 18, 2024 by chakravarthik27 2.4.0
Add Support for Chat and Instruct Model Types
#1070 opened Jul 18, 2024 by chakravarthik27 2.4.0
@chakravarthik27
Interactive UI for LLM evaluation
#1069 opened Jul 16, 2024 by dcecchini
Explore Jailbreak resource (text + visual)
#1068 opened Jul 16, 2024 by dcecchini
2
Add Tests/Metrics for Multimodal models current release
#1056 opened Jun 24, 2024 by dcecchini
@chakravarthik27
Templates for Chat Models for HuggingFace
#1034 opened May 17, 2024 by chakravarthik27 2.4.0
@chakravarthik27
Exploring LLM2LLM for Data Augmentation
#1002 opened Apr 1, 2024 by chakravarthik27
Rate Limit feature for Azure/OpenAI results generation 💡Enhancements Something can be improved
#988 opened Feb 27, 2024 by Jeff-ZYX
1
implementation of a leaderboard for different quantizations (gguf 4 vs 6 vs etc bits)
#987 opened Feb 26, 2024 by chakravarthik27
Enhancing Data Quality Testing for Langtest ⭐ Feature Indicates new feature requests
#982 opened Feb 19, 2024 by RakshitKhajuria
Explore litellm
#978 opened Feb 6, 2024 by ArshaanNazir
Do Embedding Benchamark for different datasets
#973 opened Feb 2, 2024 by ArshaanNazir
Explore AI-Secure ⏭️ Next Release Issues or Request for the next release
#971 opened Jan 31, 2024 by ArshaanNazir
Explore Together AI embedding models ⏭️ Next Release Issues or Request for the next release
#968 opened Jan 30, 2024 by dcecchini
Try different Prompting Techniques like few shot, ER , COT etc
#959 opened Jan 15, 2024 by ArshaanNazir
1
Explore Galileo's hallucination index ⏭️ Next Release Issues or Request for the next release
#957 opened Jan 11, 2024 by dcecchini
Add tests for De-Identification ⏭️ Next Release Issues or Request for the next release
#954 opened Jan 4, 2024 by dcecchini
@chakravarthik27 @ArshaanNazir
1
Add Word Embedding (with Pooling) to benchmark ⏭️ Next Release Issues or Request for the next release
#950 opened Jan 2, 2024 by dcecchini
Preparing Embeddings Benchmarks (LangTest)
#947 opened Dec 27, 2023 by ArshaanNazir
@chakravarthik27 @ArshaanNazir
9
Preparing LLM Benchmark Table ( LangTest)
#946 opened Dec 27, 2023 by ArshaanNazir
@ArshaanNazir
9
Explore Cognitive biases in LLMs ⏭️ Next Release Issues or Request for the next release
#944 opened Dec 26, 2023 by ArshaanNazir
@RakshitKhajuria
Explore Context Length Parameter ⏭️ Next Release Issues or Request for the next release
#933 opened Dec 20, 2023 by ArshaanNazir
ProTip! Follow long discussions with comments:>50.