Page 1 of 1
Empty Folder Deletion Painfully Slow
Posted: Wed Nov 20, 2024 7:39 pm
by mukoya
When executing deletion of files from an S3 compatible storage, file deletion is quite fast. Syncovery shows 11 sockets open in web page of job details
However, after file deletion, it takes very long to delete emptied folders. Says only one socket open.
Is there a way to speed up this?
I don't see any way to do parallel/simultaneous folder deletions as is the case for files.
Thank you.
Re: Empty Folder Deletion Painfully Slow
Posted: Wed Nov 20, 2024 7:59 pm
by tobias
Hello,
the main reason for the slow deletions is that Syncovery double-checks that each folder is really empty.
Which might not be necessary, especially because deleting the folder stub item would not delete any files in the folder, if they still existed.
Multithreaded folder deletion has not been implemented yet.
So, thanks for the request, I hope I can improve this in a future update. In the meantime, just don't watch it when it deletes folders.
If you generally don't care about empty folders, you can disable the folder emulation entirely. This is an option on the second tab sheet of the Internet Protocol Settings dialog. When disabled, Syncovery won't create any folder stub items and hence doesn't need to delete them. The existence of a folder is then simply implied by the existence of a file in the path. And empty folders do not exist.
Re: Empty Folder Deletion Painfully Slow
Posted: Thu Nov 21, 2024 2:23 am
by mukoya
Hi Tobias,
Thank you for your enlightening response!
I have very many folders. We are approaching a situation where the next job is due before the previous run completes folder deletions. This also keeps Syncovery running almost throughout, utilizing resources. There are times when we might need to restart server but Syncovery is busy and a restart would interfere with the running jobs.
I have unchecked "Support Empty Folders" Option as you suggested. Makes a big difference! However, for my case, I still need to clean up empty folders. There is a third party app I have used before (Remove Empty Directories - RED). I ran into a few issues with it, mainly due to the sheer number of folders it has to scan but I will try it for the meantime.
I would appreciate if folder deletion speed is improved.
Disabling double-check for folder "emptyness" when deleting could help in my specific case. You may consider making it optional.
Multi-threaded folder deletion may be of value as well. Not sure about implication on resource utilization, but I guess number of threads could be configurable.
Thank you.
Emmanuel.