Copying speed - SMB on 10Gb with large compressed files

English Support for Syncovery on Windows.
Post Reply
rogerfinch
Posts: 2
Joined: Sun Jun 12, 2022 7:14 am

Copying speed - SMB on 10Gb with large compressed files

Post by rogerfinch »

Hi

we're running a simple job to copy 25Tb of large compressed files (backups of VMs) from one Windows 2022 server to another one. Via SMB but have also tried sftp.

they are connected by 10Gb network cards and a 10Gb switch. we actually have 3x10Gb on each running in a bonded state, just to see if we can increase throughput.

the disks on both servers are RAID 5 with 12x 20Tb drives. servers are identical spec - 128Gb ram, 96 cores. lots of headroom. this is their only job.

we're seeing 25Tb copied in 12 hours. varies between 2Gbps and 7Gpbs when we run 4 file copies at once on the single job. seems faster than 1 and 8 file copies.

are there settings we can tweak to increase this? buffer settings? windows copy settings?

just need to blast these files over in the shortest window we can. (size varies from 1Gb to 800Gb)

cheers!

tobias
Posts: 1603
Joined: Tue Mar 31, 2020 7:37 pm

Re: Copying speed - SMB on 10Gb with large compressed files

Post by tobias »

Hello,
it might be better to set it to copy only 1 file simultaneously, to avoid unnecessary disk seeks.

You can also try if using the Windows API copying function increases or decreases speed. The setting is on the tab sheet "Files"->"More" in the profile.

Make sure you don't use special options such as Block Level Copying, because these will slow it down.

"Bypass File Buffering" is also usually a bad idea (on the Files tab sheet), but may sometimes actually help. But mostly to avoid high memory usage for buffering.

When not using the Windows API Copying function, the "Buffer size for copying files" may have a small effect, it is on the Advanced tab sheet of the Program Settings dialog.

rogerfinch
Posts: 2
Joined: Sun Jun 12, 2022 7:14 am

Re: Copying speed - SMB on 10Gb with large compressed files

Post by rogerfinch »

thanks Tobias

we've made the change and are testing it now.

1 file copy speed was only 2-3Gbps, so we stuck at 4 for now (as both RAIDs have 12 drives in them)

cheers for the speedy response :D

Post Reply