You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
current safetensors.load only support load memory data from bytes, while read large weight data, bytearray must convert to bytes first,this operation make memoery peak use double and copy ram is a huge cost. so read weight from bytearray can reduce cost.
Motivation
while concurrent read a large file from distribute file system(can speed up read), use bytearray can reduce ram useage,but safetensors read only support bytes memory data
Your contribution
none
The text was updated successfully, but these errors were encountered:
Feature request
current
safetensors.load
only support load memory data from bytes, while read large weight data, bytearray must convert to bytes first,this operation make memoery peak use double and copy ram is a huge cost. so read weight from bytearray can reduce cost.Motivation
while concurrent read a large file from distribute file system(can speed up read), use bytearray can reduce ram useage,but safetensors read only support bytes memory data
Your contribution
none
The text was updated successfully, but these errors were encountered: