You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to get analogous behavior to RepetitionPenaltyLogitsProcessor in tortoise.cpp. It makes use of both torch.gather and torch.Tensor.scatter_` Would there be interest in upstreamed implementations of these ops?
The text was updated successfully, but these errors were encountered:
balisujohn
changed the title
Is there interest in implementations of something analagous to torch.Tensor.scatter_ and torch.gather?
Is there interest in implementations of something analogous to torch.Tensor.scatter_ and torch.gather?
Feb 1, 2024
I am trying to get analogous behavior to
RepetitionPenaltyLogitsProcessor
in tortoise.cpp. It makes use of bothtorch.gather
and torch.Tensor.scatter_` Would there be interest in upstreamed implementations of these ops?The text was updated successfully, but these errors were encountered: