Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Tests for extend generation logic #1184

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Add Tests for extend generation logic #1184

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
6cc6a37
feat(dspy): in extend_generation, compare key values to None, not to
Jun 19, 2024
2b55ca3
feat(dspy): add tests for extend generation
Jun 19, 2024
d12e0f2
feat(dspy): revert changes to extend generation logic
Jun 19, 2024
ea29442
feat(dspy): rm redundant comments
Jun 19, 2024
15aef81
feat(dspy): revert changes to test file writing
Jun 19, 2024
4771535
feat(dspy): changed assertions so tests pass and added conversation logs
Jun 20, 2024
bcab220
feat(dsp): clarify what is generated in each generation
Jun 20, 2024
20fc91b
Merge branch 'stanfordnlp:main' into mipro-v2-extend-generation
mikeedjones Jun 21, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
feat(dspy): rm redundant comments
  • Loading branch information
JONEMI19 committed Jun 19, 2024
commit ea29442c7aea461e91e5b6d14edaafb1075e91f4
3 changes: 0 additions & 3 deletions tests/predict/test_predict.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,6 @@ class SandwichIdea(dspy.Signature):


def test_extend_generation(SandwichIdea):
# test that the completion is extended correctly
lm = DummyLM(
[
" whole wheat\n\nProtein: turkey\n\nFat: avocado",
Expand All @@ -260,7 +259,6 @@ def test_extend_generation(SandwichIdea):


def test_extend_generation_rolled_back_when_field_is_skipped(SandwichIdea):
# test the completion is rolled back when a field is skipped
lm = DummyLM(
[
" white\n\nFat: butter\n\nGarish: lettuce\n\nSauce: mayo",
Expand All @@ -278,7 +276,6 @@ def test_extend_generation_rolled_back_when_field_is_skipped(SandwichIdea):


def test_extend_generation_with_empty_field(SandwichIdea):
# test the completion is extended if the field is empty
lm = DummyLM(
[
" white\n\nProtein: \n\nFat: butter\n\nGarish: lettuce",
Expand Down
Loading