Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(sdk): Move trace processing from SDK to BE #1934

Merged
merged 3 commits into from
Jul 26, 2024

Conversation

jp-agenta
Copy link
Contributor

Move trace processing from SDK to BE. Add locals to CreateSpan, SpanDB, etc. Fix RAG evaluators error handling. Add dump trace.json in @entrypoint. Remove 'block' in Tracing(). Use existing encoder instead of json.dumps().

Move trace processing from SDK to BE. Add locals to CreateSpan, SpanDB, etc. Fix RAG evaluators error handling. Add dump trace.json in @entrypoint. Remove 'block' in Tracing(). Use existing encoder instead of json.dumps().
@jp-agenta jp-agenta requested a review from aybruhm July 25, 2024 17:32
Copy link

vercel bot commented Jul 25, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
agenta ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 26, 2024 8:53am

Copy link
Member

@aybruhm aybruhm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yup! This looks (really) good, great work @jp-agenta!

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Jul 26, 2024
@aybruhm
Copy link
Member

aybruhm commented Jul 26, 2024

I'm looking into the failing backend tests.

@aybruhm aybruhm merged commit e1d6efa into rag Jul 26, 2024
7 checks passed
@aybruhm aybruhm deleted the feature/rag/move-trace-processing-from-sdk-to-backend branch July 26, 2024 08:56
@@ -344,130 +352,3442 @@ def test_auto_levenshtein_distance(output, data_point, settings_values, expected
"message": "aloha",
},
"trace": {
Copy link
Collaborator

@aakrem aakrem Jul 26, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aybruhm @jp-agenta
Can we find a better approach to parameterize the trace please.. it will be hard to work on a 3k-line file..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Backend lgtm This PR has been approved by a maintainer refactoring SDK size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants