Syncovery Support Forum

Posted: **Tue Feb 14, 2023 3:05 am**

Thanks for making the GUI on the Linux great to use in a mirror of the window's version. It makes for easy working.

What I'm trying to do: run a backup of copies of vmware vms.

Hardware Setup: Ubuntu 20.04 lts hosting Syncovery 9 (192.168.2.82), left side VMware 6 host SSH on 192.168.2.78:22 (user-pass for authentification) (files to be backed up), right side Ubuntu 18.04 lts (local disk) 192.168.2.45:3131 (SSH key - passwordless).
Test - Syncovery can read both side's folder structure. I've also SSH connected from 192.168.2.82 to the right side and test written to the directory.

Syncovery setup: focused on sending one vm L to R. Using both a putty key and openssh formatted key. I set block level copying assuming this would help with the large contiguous VM files. I've run with preview - it builds a list without problems, then appears to start (reporting smaller files copied) then moves to the larger files (reporting very slow speeds - 4-8mb/s on a local connection). However, in reality nothing is written (even small files) to the right side.

Here is the log:

Connecting with 192.168.2.78

***** Left Side: : SFTP CONNECTION STARTS *****
Using SecureBlackBox 16.0.329.0
Accepted SSH server MD5 fingerprint: 91:fb:40:f1:4c:da:73:bc:12:76:d0:53:27:16:85:a5
Accepted SSH server SHA1 fingerprint: b0:68:08:7f:4e:9b:48:76:15:d8:7b:9d:7d:d6:cb:64:f9:78:16:68
Left Side: : SSH authentication failed, user name root, server 192.168.2.78, port 22, auth type=2.
Left Side: : SSH/SFTP message 114.
Left Side: : SSH/SFTP Server: OpenSSH_7.1
Left Side: : SFTP Version: 0, SSH EncryptionAlgorithmClientToServer:18 (aes256-ctr), EncryptionAlgorithmServerToClient:18 (aes256-ctr), MacAlgorithmClientToServer:0 (hmac-sha1), MacAlgorithmServerToClient:0 (hmac-sha1)
Left Side: : DownloadBlockSize:8192 PipelineLength:32 AutoAdjustTransferBlock:TRUE
Left Side: : SSH_EA_3DES:TRUE SSH_EA_DES:TRUE CompressionLevel:9
Left Side: : SSH Exception: Connection lost due to error 96273
Accepted SSH server MD5 fingerprint: 91:fb:40:f1:4c:da:73:bc:12:76:d0:53:27:16:85:a5
Accepted SSH server SHA1 fingerprint: b0:68:08:7f:4e:9b:48:76:15:d8:7b:9d:7d:d6:cb:64:f9:78:16:68
Left Side: : SSH/SFTP connected to OpenSSH_7.1
Left Side: : Established SFTP connection with user name root. Total number of SFTP connections: 1
Left Side: : SFTP Version: 3, SSH Encryption Algorithms used:18 (aes256-ctr), 18 (aes256-ctr), 0 (hmac-sha1), 0 (hmac-sha1)
Left Side: : SSH DownloadBlockSize:8192 PipelineLength:32 AutoAdjustTransferBlock:TRUE
Left Side: : SSH CompressionLevel:9
RIGHT SIDE: Using client certificate "JamesLinux" with /home/james/.ssh/james_linux_putty.ppk
Connecting with 192.168.2.45

***** RIGHT SIDE: SFTP CONNECTION STARTS *****
Using tgputtylib build 19 based on PuTTY Release 0.76
Copying Direction : Left To Right

Case Sensitive Mode is ON.
Using reference database in file /etc/.Syncovery/Database/vmbackup-to-linux.syncsq3dbcs (23 Folders, 52 Entries, DB size: 40,960 Bytes)

Scanning Folders Started At 02/13/2023 15:57:39

Free Space on right side: Not checked, needed: 250 GB

Main Copying Phase Started At 02/13/2023 15:57:40

Connecting with 192.168.2.78

***** Left Side: : SFTP CONNECTION STARTS *****
Left Side: : SSH authentication failed, user name root, server 192.168.2.78, port 22, auth type=2.
Left Side: : SSH/SFTP message 114.
Left Side: : SSH/SFTP Server: OpenSSH_7.1
Left Side: : SFTP Version: 0, SSH EncryptionAlgorithmClientToServer:18 (aes256-ctr), EncryptionAlgorithmServerToClient:18 (aes256-ctr), MacAlgorithmClientToServer:0 (hmac-sha1), MacAlgorithmServerToClient:0 (hmac-sha1)
Left Side: : DownloadBlockSize:8192 PipelineLength:32 AutoAdjustTransferBlock:TRUE
Left Side: : SSH_EA_3DES:TRUE SSH_EA_DES:TRUE CompressionLevel:9
Left Side: : SSH Exception: Connection lost due to error 96273
Left Side: : Established SFTP connection with user name root. Total number of SFTP connections: 2
RIGHT SIDE: Using client certificate "JamesLinux" with /home/james/.ssh/james_linux_putty.ppk
Connecting with 192.168.2.45

***** RIGHT SIDE: SFTP CONNECTION STARTS *****
Not using partial file updating for stanworth-site-flat.vmdk (destination file does not exist)
15:58:25.979 IP Exception (5): EWriteError Stream write error @ 000000000042F5E1, CP:CorEX5:Stream write error
15:58:26.281 IP Exception (5): EWriteError Stream write error @ 000000000042F5E1, CP:CorEX5:Stream write error
15:58:27.537 IP Exception (5): EWriteError Stream write error @ 000000000042F5E1, CP:CorEX5:Stream write error
15:58:29.810 IP Exception (5): EWriteError Stream write error @ 000000000042F5E1, CP:CorEX5:Stream write error
Exception Stream write error at 000000000042F5E1.
Filename: sftp://192.168.2.78/vmfs/volumes/605da835-644e529e-cb6e-001b21d32e78/daily/20230204013008/stanworthXXXX/stanworthXXXX-flat.vmdk
Checkpoints: TGGetOrPutEX:Stream write error

Errors / Access problems with 1 File:

/20230204013008/stanworthXXXX/stanworthXXXX-flat.vmdk (Stream write error at 000000000042F5E1.CP: TGGetOrPutEX:Stream write error)

Main Copying Phase Ended At 02/13/2023 15:58:29 And Took 00:00:49

Left Side: : Closing SFTP connection with user name root. Total number of SFTP connections remaining: 0
RIGHT SIDE: Closing SFTP connection with user name james. Total number of SFTP connections remaining: 0
Closing database /etc/.Syncovery/Database/vmbackup-to-linux.syncsq3dbcs
15:58:29.978 Database closed

Reference database closed: /etc/.Syncovery/Database/vmbackup-to-linux.syncsq3dbcs (23 Folders, 52 Entries, DB size: 40,960 Bytes)

SUMMARY
------------------------------------------------------------------
Short Results: INCOMPLETE: 0 copied of 1, Errors with 1 File(s)
Operation completed at 15:58:29 on 02/13/2023
Total duration: 00:00:51

Posted: **Tue Feb 14, 2023 9:01 am**

Hello,
block level copying cannot help in this case (not if both sides are SFTP).

You're running out of temp space. Syncovery needs to download the whole file locally first and then upload it to the destination.

So this setup is not good. You need to install Syncovery directly on the source machine and use a local left side path and an SFTP destination. Then you won't need a temp file and block level copying can save bandwidth.

Posted: **Wed Feb 15, 2023 3:03 pm**

Thanks.
I'm not sure, though, if tis is viable. The source machine is Esxi 6 which doesn't like having things installed on it.
Installing it on the target machine, I guess, creates similar problems?

Posted: **Wed Feb 15, 2023 4:48 pm**

Hello,
if you install it on the target machine, you will avoid needing a lot of disk space for temporary files.

Block level copying will not work, Syncovery will always have to download complete files.

The Esxi 6 simply isn't going to tell Syncovery which blocks of large files have changed.

Posted: **Sun Feb 19, 2023 2:38 am**

Thanks. I've now got this working - with Snycovery on the Target machine. I now need to test block level copying to see if I can speed things up a bit.

My next issue is how to delete files on the right side. From looking at (for example)
https://www.syncovery.com/documentation ... an-x-days/

I should setup my job in (1) mirror copying mode, (2) specify dates to keep files in the filters, (3) test run (4) give Syncovery permission to automatically/ unattended delete files (5) schedule.

Let me give this another go. I was not using mirror mode and this may be the issue. Let me test and see.

Syncovery Support Forum

Connection lost due to error 96273

Connection lost due to error 96273

Re: Connection lost due to error 96273

Re: Connection lost due to error 96273

Re: Connection lost due to error 96273

Re: Connection lost due to error 96273