-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
getting decoded output #5
Comments
Hi @ingride , Oh when you get the output_ids, you can decode back to text using the model tokenizer tokenizer.decode(output) |
sorry this might be a very dumb question, but the output is a two dimensional tensor - Base Roberta. are you suggesting to flatten it similarly to here https://github.com/ToluClassics/candle-tutorial/blob/main/tests/test_roberta.rs#L81 ? because decode takes a &[u32] slice as param. how do i get the output_ids from the two dimensional tensor / the config |
@ToluClassics any thoughts on this? |
hi.
any suggestions on how to get a decoded output once I have done
Am trying to go from a text input, extract input and token_ids, and then decode to a text output. I tried to do some basic convert but didn't get anywhere. if you have an example, I would appreciate it, am kinda struggling to connect the bits.
The text was updated successfully, but these errors were encountered: