Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Langsmith integration #1104

Open
propertius opened this issue May 14, 2024 · 7 comments
Open

[FEATURE] Langsmith integration #1104

propertius opened this issue May 14, 2024 · 7 comments
Labels
enhancement New feature or request P3 Medium priority

Comments

@propertius
Copy link

This is somewhat related to #246: What would be the appropriate way to integrate LangSmith when using this library?
Many thanks in advance!

@propertius propertius added the enhancement New feature or request label May 14, 2024
@langchain4j
Copy link
Owner

Hey @propertius, #1058 will be finalized and released next week.
One could then implement a listener and hook it to the model. One of the implementations can be for LangSmith, others for OTel, etc.
I guess it will make sense to have an out-of-the-box implementation of LangSmith in langchain4j, are you interested to implement that?
There is an official java sdk: https://github.com/langchain-ai/langsmith-java

@langchain4j langchain4j added the P3 Medium priority label May 14, 2024
@propertius
Copy link
Author

Hi @langchain4j, thanks for your promptly answer. I cannot commit to the implementation yet, as we are still evaluating our options within the company.

@langchain4j
Copy link
Owner

@propertius Sure! What options do you have in mind?

@propertius
Copy link
Author

Hi @langchain4j: we're evaluating using the Open AI Assistants API + Tools directly. The cons are of course, we would make us vendor dependent. I like your stack a lot. Observability would be a major plus by your solution.

@langchain4j
Copy link
Owner

@propertius Ah, I see. I thought you were talking about observability options. Do you consider LangSmith only or other options as well?

@showpune
Copy link

Hi @langchain4j
I am interested that beside langchain smith, can we also integrated with opentelemetry for trace? What I think we need to enhance include

  1. span process in new thread like in RetrievalAugmentor
  2. Add some auto-instrument in opentelemetry

@langchain4j
Copy link
Owner

@showpune we are working towards supporting OTel, this is a first step: #1058

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request P3 Medium priority
Projects
None yet
Development

No branches or pull requests

3 participants