Skip to content

Commit

Permalink
rpc : track allocated buffers (llama/7411)
Browse files Browse the repository at this point in the history 
* rpc : track allocated buffers

ref: #7407

* rpc : pack rpc_tensor tightly
  • Loading branch information
@rgerganov @ggerganov
rgerganov authored and ggerganov committed May 28, 2024
1 parent c480d2d commit 35e341b
Showing 1 changed file with 176 additions and 53 deletions.
Loading

0 comments on commit 35e341b

Please sign in to comment.