Replies: 1 comment
-
Context on the above : I mean also with reference to the similarity to example answers... so measures of similarity of text would be very useful |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I'm just getting started with DSpy and I have come to realise that building metrics is a core problem.
I get the feeling that there are a lot of common qualities of a desired output that I will want to evaluate; for example:
well you get the idea !
Basically I want to create a non-functional description of the text that's emitted. Well and good! But -- has anyone done this or started on this before I start writing these things?
Also do people have other better ideas about how I can describe the structure of the outputs that I am expecting?
Beta Was this translation helpful? Give feedback.
All reactions