-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
dspy and langfuse integration #1179
Comments
Are you suggesting something like saving the compiled optimized json programs that DSPy creates to langfuse? (at your prompt management). Or something else? Can you give some more details of what you see happening? |
|
That´s a good suggestion. On my side, I would want DSPy integration with Langfuse. That is, I want to see the calls that DSPy makes to LLM, grouped into traces and spans. I see there was a PR for this: #200 |
I also noticed this PR, unfortunately,it was submitted on Oct 31, 2023, and has not been merged yet, dspy and langfuse have been updated for many versions. So far, I have completed part of the code for |
Feel free to build on #200 @xucailiang (will need to be updated with latest DSPy and/or Langfuse changes) or open a new PR for this integration! |
As you said, I have submitted the relevant code, PR thank you everyone🙏 |
Hi , @xucailiang I was still not able to see any traces of my azure model's cost on locally hosted langfuse dashboard |
hi,The PR for integrating langfuse is under review by @arnavsinghvi11 and we are all looking forward to this feature! |
Hi @Aaryaveerkrishna23 Were you able to see traces now as the PR got integrated into the main? Let me know if you have found out a way to see the traces using dspy and languse! |
@xucailiang after your work here, is there any way to manipulate the current trace, and group together all dspy call in one trace? e.g. how to call https://python.reference.langfuse.com/langfuse/decorators#LangfuseDecorator.update_current_trace properly. Thanks a lot! |
Do you mean you want to manage the trace yourself? if you need to manage langfuse yourself, you can get the langfuse object after you instantiate LangfuseTracker, |
Langfuse is a good prompt management project.
I would like to know if dspy has plans to support langfuse.
and I have written some code for this and am currently verifying them
Thank you all🙏
The text was updated successfully, but these errors were encountered: