Add a partSize parameter. #537
Conversation
| @@ -187,11 +187,11 @@ func (fh *FileHandle) partSize() uint64 { | |||
| var size uint64 | |||
|
|
|||
| if fh.lastPartId < 1000 { | |||
| size = 5 * 1024 * 1024 | |||
| size = fh.inode.fs.flags.MPUPartSize | |||
There was a problem hiding this comment.
This behavior may confuse users. Instead, how about using a fixed size when provided by the flag and this gradually increasing size when not provided?
There was a problem hiding this comment.
OK, we can further discussing this after we accept this proposal
|
Could you explain what's the motivation of configuring the part size? |
|
@kahing Now Ozone use Goofys as a fuse interface, Goofys talk to Ozone s3gateway now, but there are a performance issue when the partSize is not suitable to Ozone chunkSize, now Ozone chunk is 4MB, and goofys partSize is 5MB, so it will cost two time read Chunk when read file, If we set the partSize to 8MB, when read this part, two time read chunk can read 8MB from ozone datanode, with this feature, we can improve 3x read performance. |
By this parameter, we can specify a customized partSize.