FAQ and Knowledge Base

Main Page > Browse Categories > How To / Articles > Processing a Large Amount of Files Using Multiple Profiles

Processing a Large Amount of Files Using Multiple Profiles

*** Requires ViceVersa PRO 2.5 build 2502 or any later version ***

When processing a large amount of files (e.g. more than 1 million) it is recommended to setup multiple profiles. Using multiple profiles makes the data more manageable and uses less memory.

Subfolder filters (and/or file filters as needed) help select which subfolders to include in which profile.

 


*** Example 1 (split into 2 profiles) ***

Need to Replicate, Backup or Sync:
----------------------------------
Source: c:\SourceFolder\ 
Target: X:\TargetFolder\

Profile A
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[a-n]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with a to n)

Profile B
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Exclude Subfolder Filter \[a-n]* - Case Sensitive: No
(This filter excludes all level-1 subfolders with names starting with a to n)

Profile A + Profile B combined will replicate / backup / sync all files from c:\SourceFolder\ to  X:\TargetFolder\

Profiles can be run sequentially using VVEngine.

 


*** Example 2 (split into 3 profiles) ***

Need to Replicate, Backup or Sync:
----------------------------------
Source: c:\SourceFolder\
Target: X:\TargetFolder\

Profile A
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[abcdefg]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with a, b, c, d, e, f or g)

Profile B
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[p-z]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with p to z)

Profile C
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Exclude Subfolder Filter \[p-z]* - Case Sensitive: No
(This filter excludes all level-1 subfolders starting with p to z)
Exclude Subfolder Filter \[abcdefg]* - Case Sensitive: No
(This filter excludes all level-1 subfolders starting with a, b, c, d, e, f or g)

Profile A + Profile B + Profile C combined will replicate / backup / sync all files from c:\SourceFolder\ to  X:\TargetFolder\

Profiles can be run sequentially using VVEngine.

Instead of subfolder filters, file filters can be used to target individual files.



User Comments
Add Comment
Mark -  08-May-17
I am trying to set filters as I have many files. It seams that I may be doing something wrong. Whether I set include, exclude, on a directory or a group of directories the software seems to be scanning all the directories. Here is my most recent attempt to include just 5 directories any thoughts?

Profile File: C:\Users\crredact\Documents\ViceVersa PRO\Include5 directories.fsf

Folders
- Source: "\\rtthanas\orimglib\Public\Recorded\Instrument Number\"
- Target: "E:\data\rsync\ORImgLib\Public\Recorded\Instrument Number\"
- Include Subfolders: Yes
- Create sources/targets that do not exist
- Include subfolders: "\[100000000-100040000]*"
TGRMN Software -  10-May-17
Which subfolders do you mean to include with:
Include subfolders: "\[100000000-100040000]*"
Add Comment
Attachments
No attachments

Did this help you?
Yes No

Statistics
70% found this information useful

Other Options
Printable Version

General Information
No. 104
Author: TGRMN Software

Download ViceVersa


Visit ViceVersa Forum
  
  
 A printable version of the entire ViceVersa FAQ and Knowledge Base is also available.

 For further queries, please contact us by E-Mail at support@tgrmn.com.