Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/huggingface pipeline streaming #331

Merged
merged 6 commits into from
Feb 15, 2024
Merged

Feature/huggingface pipeline streaming #331

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
a61b28a
Added NeMo Guardrails streaming support for LLMs deployed using Huggi…
trebedea Feb 14, 2024
b50316e
GenerationChunk is needed for on_llm_new_token
trebedea Feb 14, 2024
65d714b
Added some additional documentation and example for streaming with Hu…
trebedea Feb 14, 2024
96a29d1
Merge branch 'develop' into feature/huggingface-pipeline-streaming
drazvan Feb 15, 2024
47e3f15
Disable dialog rails for HF dolly example.
drazvan Feb 15, 2024
634d15e
Tweak and fix the streaming for HuggingFace pipeline.
drazvan Feb 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'develop' into feature/huggingface-pipeline-streaming
  • Loading branch information
@drazvan
drazvan committed Feb 15, 2024
commit 96a29d1dbf22bf479ef7b422d226b5fd4c87930f

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.