-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
LabelFewShot and Dspy.Suggest #1131
Comments
Hi @chiragshah285, to me it seems that it should work (I'm not a maintainer though). Is it not working? Don't know the size of your dataset or what LM you are using, but if you really want to get the best performance, maybe it could make sense to increase the number of samples that LabeledFewShot uses. The default value is 16. |
thanks @tom-doerr yeah I was just take 2 examples as a quick test. The problem is more LabelFewShot doesn't support dspy.Suggestion after compilation, from what I see in the code |
Hi @chiragshah285 , your code looks correct in terms of using Suggestion within the program. What error do you get while running the code? DSPy.Suggestions/Assertions are currently compatible with |
thanks @arnavsinghvi11 here is my error message:
|
ignore this, this works now! thanks for taking a look |
Can I use LabeledFewShot with dspy suggestion? I have a bunch of labeled input/output pairs already. I want to compile use that program and do assertions on newly generated outputs. Am I thinking about this the right way? Since I have labeled example already I just need ensure the new outputs from the model are generated per a rule set.
Here is what I'm looking to do:
The text was updated successfully, but these errors were encountered: