Can it keep with 1280 files per hour?

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

Hi. First of all, so far I am very impressed although I have yet to deploy the trial in my production environment. I am testing it at home, and I THINK it is going to work for me, but I have a couple questions.

I have a video recording system that continuously creates small avi files......non stop. I creates about 64 files every 3 minutes. The files range in size from 100KB to 20MB. The problem is, we have a limited amount of static storage, enough to keep about 3 months worth of avi files, but then the system overwrites the oldest file, and it is gone forever.....

The program creates a new folder everyday in a date format: 082207, 082307, etc... Each folder has the AVI files.

My plan is to use the real time sync - augment mode, to simply copy the files as they are created to a 1TB USB 2 drive. Assuming file size is the avrg we are expecting, the TB drive will be filled up every month. The 1TB drive will be removed and replaced with a new one. So here's a question...

I am using the Engine, and assume I would simply stop the running profile when the drive gets full, put in the new drive and rerun the profile. Would it then go back and copy all the old files again??? I would only want it to copy the files that were newly created but did not have a chance to be replicated to the target before the target was full. Is there a way to alert a connected workstation that the target is FULL and needs to be changed? I am trying to make it as simple for the end user as unplugging the drive when a TARGET FULL msg appears, have them put in the new drive, and have the system automatically pick up where it left off. This would be absolutely amazing if this could work!!! Thanks again for reading thru this message, and I look forward to any feedback you can provide.. Very Happy

_________________
joe

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8693

This would work, but when you replace the full drive with a new one, VV will copy all files again from source to target. VV compares source and target folders and then copies everything that is not in source to target....
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

Well, I would be using the exclude all files that more than one day old. It would have to back that up, so I may duplicate about 50 GB of files on every removeable USB. Would love if the Exclude Files Older than xxx could be XXX days, hours, weeks, etc..... instead of just days.. That would help me out...and hey, maybe others!!

So, how would I handle the full USB drive. If i am not constantly monitoring the web page for VVEngine, how do I know when it will be time to change the drive?? Also, I am not monitoring the target, so would it still have to do a full comparison when the new drive is plugged in???
_________________
joe

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8693

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

....and these errors can trigger what kind of alert for someone that doesn't look at the logs? Could it execute the e-mail script? Net Send Msg?? etc...?

And what would the behavior be when a new drive is installed? I have the VVEngine set to start the profile as soon as the drives become ready, but where will it pick up?
_________________
joe

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8693

Guest · Posted: Sat Aug 25, 2007 1:49 am Post subject:

Hmm.. Not sure it's actually "keeping up" so to speak.. It seems as though as soon as a change in the source is detected, it runs the whole profile and not just copy the new files to the target. I don't need to ever really check the target. So what is happening is that it detects a change, does the whole profile, repeat. Each time it takes about 15 minutes. I was thinking it would simply keep copying the new files, but it looks like it has do it all over again. The problem is, during the time it does the compare, and copies the files from that compare, it has to add about 200-250 files..

I am attaching a log file in an e-mail to TGRMN support.

Thanks again for all your help!

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

OOPS! Sorry, the guest post above was mine... I thought I was logged in!
_________________
joe

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8693

Yes, in the current version VV scans the target folder to check which files need copying. In the next version VV will be enhanced not to do that, which will make the file synchronization / replication faster...
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8693

InDashMP3 · Joined: 22 Aug 2007 Posts: 8

I believe that the source as specified is as specific as I can get. New folders are created every day, so I must keep the source scan one layer above that so that the profile cathes the new folders...
_________________
joe