You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
GGUF should allow writing through a stream since calling gguf_write_to_file makes a copy of the data internally, It would be best to write the tensor data to a file stream, to avoid excessive RAM consumption for larger models.
The text was updated successfully, but these errors were encountered:
GGUF should allow writing through a stream since calling
gguf_write_to_file
makes a copy of the data internally, It would be best to write the tensor data to a file stream, to avoid excessive RAM consumption for larger models.The text was updated successfully, but these errors were encountered: