Forum Index  ViceVersa HOME         FAQ and Knowledge Base

 FAQForum FAQ   SearchSearch Forum  RegisterRegister 
 ProfileProfile   Log inLog in 

VV 4 and multithreading

 
Post new topic   Reply to topic     Forum Index -> Comments / Feedback
Author Message
Adequat



Joined: 05 Jul 2006
Posts: 65

PostPosted: Sat Apr 23, 2022 6:37 pm    Post subject: VV 4 and multithreading Reply with quote

I have just upgraded to version 4 (from version 2.5), and according to the feature list, I expected to see the source and destination folders be scanned at the same time and not one after the other. But no Sad
(of course, I activated the 4 threading options).

Why not this obvious feature, that I had already requested maybe 10 years ago?...[/img][/url]
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8768

PostPosted: Mon Apr 25, 2022 12:19 am    Post subject: Reply with quote

Hi, the target will be scanned at the same time while source scanning is happening and added to the cache. You can check the profile log for this.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
Adequat



Joined: 05 Jul 2006
Posts: 65

PostPosted: Tue Apr 26, 2022 10:39 am    Post subject: Reply with quote

This is not what I see when I observe the log progress:
First the long scanning of the source, then, the scanning of the target.

See log extract below:

Quote:
Profile settings modified using options specified on the command line.
Connecting to \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk ... Connected.
Connecting to \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk2 ... Connected.
Using large fetch during scanning.
Multithreaded - Threads: 16
Prefetch of target enabled.
Checking source \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk\ ...
Multithreaded source scanning enabled.
Source Scan Time: 29 sec 505 ms
Multiscanned from source (Total: 37 362 - Files: 30 943 - Subfolders: 6 419)
Total found: 36 517

Pre-fetched from target while scanning source (Total: 37 539 - Files: 30 897 - Subfolders: 6 642)
Checking target \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk2\ ...
Multithreaded target scanning enabled.
Target Scan Time: 28 sec 142 ms
Multiscanned from target (Total: 37 000 - Files: 30 263 - Subfolders: 6 737)
Total found: 36 211
Comparing ...
Multithreaded comparison enabled.
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8768

PostPosted: Wed Apr 27, 2022 12:28 am    Post subject: Reply with quote

Hi,

this is the indication that ViceVersa has pre-fetched from target while scanning the source :

Pre-fetched from target while scanning source (Total: 37 539 - Files: 30 897 - Subfolders: 6 642)


Are you seeing some improvements from the new 4 multi-threading options?

thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
Adequat



Joined: 05 Jul 2006
Posts: 65

PostPosted: Wed Apr 27, 2022 8:53 am    Post subject: Reply with quote

Quote:
this is the indication that ViceVersa has pre-fetched from the target while scanning the source :


At least, this is not reflected in the UI: we see the number of source files being progressively scanned, then when this number reaches the maximum, the number of destination files starts to increase.
Therefore, even if I don't know what's going on in the underground, this gives me the feeling of a two-stage process. And the log progressive output reinforces this feeling.

Quote:
Are you seeing some improvements from the new 4 multi-threading options?


For the copy stage (ie. after the scan stage), there is definitely a big speedup Smile
... but this is a fragment of the time it takes to scan.

Philippe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8768

PostPosted: Thu Apr 28, 2022 12:29 am    Post subject: Reply with quote

Yes, ViceVersa still loading the target after the source, but it pre-caches the target while scanning the source.

Re scanning... are the options "multithreaded source scanning" and "multithreaded target scanning" speeding up the scan for you?

thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
Adequat



Joined: 05 Jul 2006
Posts: 65

PostPosted: Fri Apr 29, 2022 7:06 am    Post subject: Reply with quote

Quote:
Yes, ViceVersa still loading the target after the source


Do you think you could change that sometime? This is my bottleneck.

Quote:
but it pre-caches the target while scanning the source.


What do you mean with this?

Quote:
Re scanning... are the options "multithreaded source scanning" and "multithreaded target scanning" speeding up the scan for you?


Only if scanning my local SSDs, and not through the network. But this is normal and I can't blame this.

Philippe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8768

PostPosted: Tue May 03, 2022 12:26 am    Post subject: Reply with quote

Quote:
What do you mean with this?


It pre-loads the target, so when it goes scanning the target after the source, it should be faster.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
Display posts from previous:   
Post new topic   Reply to topic     Forum Index -> Comments / Feedback All times are GMT
Page 1 of 1

 
Jump to:  
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © phpBB Group
Copyright © TGRMN Software. TGRMN Software products: