PCloud: Invalid files

English Support for Cloud Storage
tobias
Posts: 1605
Joined: Tue Mar 31, 2020 7:37 pm

Re: PCloud: Invalid files

Post by tobias »

Hi,

Test Integrity is faster than doing a normal run with the checkmark "Binary Comparison of Existing Files" on the tab sheet Comparison->More in the profile.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

I am still running into problems.

I have 32mb file in my backup.

Then: Test Integrity shows an error. Manual download and unzipping the encrypted-zip file does not succeed. So the problem is confirmed. The file at PCloud is only 7MB of size.

So there is a problem.

The zip file was uploaded to Pcloud via Syncovery, but I cannot find this action in the log files.
Edit: Only 50 log files were kept...

How is this possible?
How can I diagnose this further?
Last edited by mareike1988 on Fri Nov 04, 2022 5:35 pm, edited 1 time in total.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

If I run the sync in "attended" mode, Syncovery shows that it won't make an update to this file.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

OK maybe I uploaded some files with the old settings and did not delete them. I will delete the integrity error files and continue uploading,

tobias
Posts: 1605
Joined: Tue Mar 31, 2020 7:37 pm

Re: PCloud: Invalid files

Post by tobias »

Hi,
yes if you use the Auto-Resume setting with interim filenames it cannot happen.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

I have successfully worked now with local file to PCloud using the Resume-Function.

However:
I have again lots of invalid files on the PCloud sides when copying from Dropbox as source (left).
Test Backup Integrity throws Invalid Files - and yes manually downloading the ZIP confirms the PCloud-ZIP-File as corrupt.

Setting Dropbox LEFT
- Resume ON (although I don't see how this is relevant?)

Setting PCloud RIGHT
- Resume ON
- Date in Filename ON

Other settings
- verify copied files ON
- encryption ON


I did a test:
Backup of large file (150MB, 2022-11-30 17.51.18.mov ), then cancelling during the upload part....
and on Pcloud now a 14 MB (2022-11-30 17.51.18.d20221130-u165118.mov.s183649654.zip) file exists. obviously invalid.
Last edited by mareike1988 on Fri Dec 16, 2022 1:15 pm, edited 1 time in total.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

LOG
Syncovery v9.48i, build 413 (64-bit)

Licensed to: ###
Running on : M-MacBook-Air
Running as : UsernameMacOs
System Info: macOS v12.6.1, Build 21G217

Log for profile SyncDropboxOnlineto_PCloud TEST, started at 13:25:34 on 16.12.22

LEFT: ext://DropBox/Test
RIGHT: ext://PCloud/Test

The profile is run in attended mode.


13:25:34.692: Opening Database: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/SyncDropboxOnline_to_PCloud TEST.syncsq3db
13:25:34.741: Database Opening Complete
Connecting with DropBox
Using OpenSSL 1.1.1h 22 Sep 2020: /Applications/Syncovery.app/Contents/MacOS/libssl.1.1.dylib, /Applications/Syncovery.app/Contents/MacOS/libcrypto.1.1.dylib

Connecting with PCloud
Copying Direction : Left To Right
Exact Mirror Mode is being used.

Using reference database in file /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/SyncDropboxOnline_to_PCloud TEST.syncsq3db (0 Folders, 0 Entries, DB size: 32.768 Bytes)

Scanning Folders Started At 16.12.22 13:25:35
16.12.22 13:25:34 DropBoxV2: Verifying Access Tokens
16.12.22 13:25:35 DropBoxV2: Connect Successful
16.12.22 13:25:35 PCloud: Connect Successful
16.12.22 13:25:35 DropBoxV2: Connect Successful
13:25:35.786: Opening Database: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox]v3.syncsq3db
13:25:35.911: Database Opening Complete
Using Cloud Cache Database: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox]v3.syncsq3db (0 Folders, 0 Entries, DB size: 32.768 Bytes)
Getting changes history for dropboxv2_Dropbox from checkpoint
Item count in base folder: 0
At end (1), FDirectorySize=0 -> FDirectorySizeWithStartAndEndHeader=32
16.12.22 13:25:35 Getting Listing from DropBox, using JSON Cache file /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox].D41D8CD98F00B204E9800998ECF8427E.json
16.12.22 13:25:35 Getting Listing from DropBox, Part 1
Confirmed no more changes to process.
16.12.22 13:25:36: Received 2 pages of changes.
16.12.22 13:25:36 Using JSON Cache File: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox].D41D8CD98F00B204E9800998ECF8427E.json
16.12.22 13:25:36 Opened JSON Cache File: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox].D41D8CD98F00B204E9800998ECF8427E.json, size is: 811
Writing the folder and file listing to a new cloud cache database.
Scanning folders took 00:00:02 (hh:mm:ss) for 1 folders
PCloud Listing Size: 357 Bytes
Scanning folders took 00:00:00 (hh:mm:ss)

Free Space on right side: Not checked, needed: 183.650 kB

Main Copying Phase Started At 16.12.22 13:25:41

16.12.22 13:27:53 PCloud: Starting upload of 2022-11-30 17.51.18.d20221130-u165118.mov.s183649654.zip (183221339 Bytes)
16.12.22 13:30:42 PCloud: Exception uploading 2022-11-30 17.51.18.d20221130-u165118.mov.s183649654.zip: Aborting (SkStat) (ETGFTPCanceled), CP:SynHttpsPutRaise4
16.12.22 13:30:42 PCloud: Final exception uploading 2022-11-30 17.51.18.d20221130-u165118.mov.s183649654.zip: Aborting (SkStat) (ETGFTPCanceled) (1 attempts uploading stream) (EFinalCloudException)
Binary Verification succeeded
Encrypting (AES256) /var/folders/sq/j89wpl1573n566vd13f3qy4m0000gn/T/TGTEMP50621-284913664-1.$$$ to /var/folders/sq/j89wpl1573n566vd13f3qy4m0000gn/T/Backup 470.4648019456.33554436.123145587224576-1671193660639-785987762.zip
name in ZIP: 2022-11-30 17.51.18.mov
13:27:53.347 Testing /var/folders/sq/j89wpl1573n566vd13f3qy4m0000gn/T/Backup 470.4648019456.33554436.123145587224576-1671193660639-785987762.zip
16.12.22 13:30:42 SynHttpsPut: Aborting (SkStat) (ETGFTPCanceled) @0000000103E14591, ResultCode=0, Result=

************************************************************************
16.12.22 13:30:42 ERROR (ETGFTPCanceled): Aborting (SkStat) @ 0000000103E14591, Thread ID: 123145587224576, CP: SHPutEX:Aborting (SkStat) (SynHttpsPut)
************************************************************************

Exception Operation Canceled at 0000000102A615E0.
Filename: /var/folders/sq/j89wpl1573n566vd13f3qy4m0000gn/T/Backup 470.4648019456.33554436.123145587224576-1671193660639-785987762.zip
Checkpoints: TGGetOrPutEX:Operation Canceled
Main Copying Phase Ended At 16.12.22 13:30:43 And Took 00:05:01

Closing database /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/DropBoxV2_Cache_Test[dropboxv2_Dropbox]v3.syncsq3db
13:30:43.363 Database closed
Closing database /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/SyncDropboxOnline_to_PCloud TEST.syncsq3db
13:30:44.437 Database closed

Reference database closed: /Users/UsernameMacOs/Library/Application Support/Syncovery/Database/SyncDropboxOnline_to_PCloud TEST.syncsq3db (1 Folders, 1 Entries, DB size: 32.768 Bytes)

Operation Canceled

SUMMARY
------------------------------------------------------------------
Short Results: INCOMPLETE: 0 copied of 1, Errors with 1 File(s)
Operation completed at 13:30:44 on 16.12.22
Total duration: 00:05:09

Errors with 1 File(s).



Local time zone offset: 1.0 hours.
Internet protocol timeout: 60 seconds
Max. Internet protocol retries: 2
SQLite version: 3.37.0

------------------------------------------------------------------

Profile Settings From /Users/UsernameMacOs/Library/Preferences/Syncovery.cfg

[General]
Name=SyncDropboxOnline_to_PCloud TEST
LastModified=16.12.22 13:25:09
Disabled=Yes
LeftPath=ext://DropBox/Test
RightPath=ext://PCloud/Test
Subfolders=Yes
LeftToRight=Yes
RightToLeft=No
UseSubfolderSelection=No

[Comparison]
AdjustFolderTimes=Yes
SizeConflictAction=scaCopy

[Exact Mirror Config]
ExactMirrorDeletes=Yes
ExactMirrorReplacesNewerFiles=Yes

[Files]
VerifyAfterCopy=Yes
MaxParallelCopiers=1

[Internet]
LeftFTPSettings=Ext:ExtProt=DropBoxV2,Flags=UTF8+UTC+DetectTimezone,"Proxy=no",Lib=0
LeftExtendedProtocolName=DropBoxV2
LeftUser=Dropbox
RightFTPSettings=Ext:ExtProt=PCloud,Flags=UTF8+UTC+DetectTimezone,"Proxy=no",Lib=0
RightUser=PCloud_
RightExtendedProtocolName=PCloud

[Inclusion Masks]
FileMasks=(all);

[Exclusion Masks]
ExcludeFileMasks=(none);

[Safety->Attended]
WarnReadOnly=No
WarnLarger=No
WarnNewer=No

[Safety->Unattended]
UnattendedDeleteMaxPercent=10

[Schedule]
ScheduledNormally=Yes
RepeatAfter=Yes
OrigTimeOfDay=15:43:16
Mins=180

[Schedule->More]
HandleMissedJobs=No

[Special]
SecurityFlag=85
OwnerMode=CopyFromSource
PermissionsMode=CopyFromSource

[Special->Database]
NameForDatabase=SyncDropboxOnline_to_PCloud TEST
DBLeftBasePath=ext://DropBox/Test
DBRightBasePath=ext://PCloud/Test

[Versioning]
FilenameEncoding=Yes

[Waiting & Retrying]
WaitForAccess=No
TolerateDisconnections=No
RetryFileList=No

[Zipping]
ZipFilesIndividually=Yes
EncryptionLevel=6

Default System Codepage: 65001

------------------------------------------------------------------
Email Notification Settings:
Email Notification is OFF.
------------------------------------------------------------------

tobias
Posts: 1605
Joined: Tue Mar 31, 2020 7:37 pm

Re: PCloud: Invalid files

Post by tobias »

Hello,
copying from one cloud protocol to another is surely different than uploading from local. I think the latest Syncovery update fixes your problems. You can turn off "Filename Encoding" but you don't have to. You do not have to re-do any of your backup, because encoded filenames can be freely mixed with non-encoded ones.

There is no need to add the timestamp to filenames on PCloud any more, because Syncovery sends the original modification date to PCloud when uploading a file.

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

Hi,

thanks OK. I have created a new profile and NOT turned the "date in filename" ON, but I did activate "resume" (both settings for PCloud).

I have to say this is quite advanced knowledge to have.

What other settings can one not use to not harm the integrity of the file transfer to Pcloud?

mareike1988
Posts: 32
Joined: Thu Oct 20, 2022 1:43 pm

Re: PCloud: Invalid files

Post by mareike1988 »

Sorry but please make a test: Dropbox to PCloud
Resume ON, Encryption ON, Filename Encoding OFF

Transfer a large file, and then during the PCloud-uploading stage cancel the process.

100% an invalid ZIP-File is on the right-PCloud-side.

Post Reply