Page 1 of 1

ZIP split size.. are they split first and uploaded second?

Posted: Mon Jul 08, 2024 4:07 pm
by dennis1
I need to sync a large non-compressible file (1.5TB) with S3.My temp space is just 1TB, so I thought why not using the ZIP split size option (set to 500G), but it failed. The ZIP file is created first with all its parts and THEN uploaded, right? I need to use ZIP here, but that does mean, I can't sync that big file with S3, right?

Re: ZIP split size.. are they split first and uploaded second?

Posted: Mon Jul 08, 2024 4:50 pm
by tobias
Hello,

yes that's correct, you can't use zip. You could upload the file uncompressed without issues.

Also, if you use the new Sz format instead of zip, it will be fine. It doesn’t use temporary files. It doesn’t split them either, I think, because it’s not needed.