| Author |
Message |
Adequat
Joined: 05 Jul 2006
Posts: 65
|
 Posted: Sat Apr 23, 2022 6:37 pm Post subject: VV 4 and multithreading |
 |
|
I have just upgraded to version 4 (from version 2.5), and according to the feature list, I expected to see the source and destination folders be scanned at the same time and not one after the other. But no 
(of course, I activated the 4 threading options).
Why not this obvious feature, that I had already requested maybe 10 years ago?...[/img][/url] |
|
| Back to top |
|
 |
TGRMN Software
Site Admin
Joined: 10 Jan 2005
Posts: 8682
|
| Posted: Mon Apr 25, 2022 12:19 am Post subject: |
|
|
Hi, the target will be scanned at the same time while source scanning is happening and added to the cache. You can check the profile log for this.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
| Back to top |
|
|
Adequat
Joined: 05 Jul 2006
Posts: 65
|
| Posted: Tue Apr 26, 2022 10:39 am Post subject: |
|
|
This is not what I see when I observe the log progress:
First the long scanning of the source, then, the scanning of the target.
See log extract below:
| Quote: | Profile settings modified using options specified on the command line.
Connecting to \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk ... Connected.
Connecting to \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk2 ... Connected.
Using large fetch during scanning.
Multithreaded - Threads: 16
Prefetch of target enabled.
Checking source \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk\ ...
Multithreaded source scanning enabled.
Source Scan Time: 29 sec 505 ms
Multiscanned from source (Total: 37 362 - Files: 30 943 - Subfolders: 6 419)
Total found: 36 517
Pre-fetched from target while scanning source (Total: 37 539 - Files: 30 897 - Subfolders: 6 642)
Checking target \\MAC-459C6F\Macintosh HD\Users\philippe\Work\Trunk2\ ...
Multithreaded target scanning enabled.
Target Scan Time: 28 sec 142 ms
Multiscanned from target (Total: 37 000 - Files: 30 263 - Subfolders: 6 737)
Total found: 36 211
Comparing ...
Multithreaded comparison enabled.
|
|
|
| Back to top |
|
|
TGRMN Software
Site Admin
Joined: 10 Jan 2005
Posts: 8682
|
| Posted: Wed Apr 27, 2022 12:28 am Post subject: |
|
|
Hi,
this is the indication that ViceVersa has pre-fetched from target while scanning the source :
Pre-fetched from target while scanning source (Total: 37 539 - Files: 30 897 - Subfolders: 6 642)
Are you seeing some improvements from the new 4 multi-threading options?
thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
| Back to top |
|
|
Adequat
Joined: 05 Jul 2006
Posts: 65
|
| Posted: Wed Apr 27, 2022 8:53 am Post subject: |
|
|
| Quote: | | this is the indication that ViceVersa has pre-fetched from the target while scanning the source : |
At least, this is not reflected in the UI: we see the number of source files being progressively scanned, then when this number reaches the maximum, the number of destination files starts to increase.
Therefore, even if I don't know what's going on in the underground, this gives me the feeling of a two-stage process. And the log progressive output reinforces this feeling.
| Quote: | | Are you seeing some improvements from the new 4 multi-threading options? |
For the copy stage (ie. after the scan stage), there is definitely a big speedup 
... but this is a fragment of the time it takes to scan.
Philippe |
|
| Back to top |
|
|
TGRMN Software
Site Admin
Joined: 10 Jan 2005
Posts: 8682
|
| Posted: Thu Apr 28, 2022 12:29 am Post subject: |
|
|
Yes, ViceVersa still loading the target after the source, but it pre-caches the target while scanning the source.
Re scanning... are the options "multithreaded source scanning" and "multithreaded target scanning" speeding up the scan for you?
thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
| Back to top |
|
|
Adequat
Joined: 05 Jul 2006
Posts: 65
|
| Posted: Fri Apr 29, 2022 7:06 am Post subject: |
|
|
| Quote: | | Yes, ViceVersa still loading the target after the source |
Do you think you could change that sometime? This is my bottleneck.
| Quote: | | but it pre-caches the target while scanning the source. |
What do you mean with this?
| Quote: | | Re scanning... are the options "multithreaded source scanning" and "multithreaded target scanning" speeding up the scan for you? |
Only if scanning my local SSDs, and not through the network. But this is normal and I can't blame this.
Philippe |
|
| Back to top |
|
|
TGRMN Software
Site Admin
Joined: 10 Jan 2005
Posts: 8682
|
| Posted: Tue May 03, 2022 12:26 am Post subject: |
|
|
| Quote: | | What do you mean with this? |
It pre-loads the target, so when it goes scanning the target after the source, it should be faster.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
| Back to top |
|
|
|
ViceVersa HOME 
Forum FAQ
Search Forum
Register
Profile
Log in
