Replies: 2 comments
-
OK, I see that the issue is that the I'm still confused about the parameterization. I chose as model Is there any way to audit the JSON that dspy sends over the wire? |
Beta Was this translation helpful? Give feedback.
-
OK, I now see that OpenAI has an output length in addition to a context length limit, and the maximum output length for GPT4-Turbo is only 4K. It might have been better if the API keyword had been |
Beta Was this translation helpful? Give feedback.
-
I was working through the intro jupyter notebook with a problem of my own, and when I got to the
ChainOfThought
predictor I saw something I didn't expect: the question was right, the answer was well-formed (though incorrect), but the rationale was incomplete. When I printpred.rationale
, what I get is truncated. The rationale is a numbered list, and it has items 1 and 2 complete, but is clipped part of the way through the 3rd item.Why does this happen, and is it possible to avoid it happening?
Beta Was this translation helpful? Give feedback.
All reactions