Comparing Resco Backup and BackupBuddyVFS Pro

Published on: 23rd March 2007. Updated on: 26th March 2007.


I'm publishing this review because my Mac applications have links with Palm PDA usage, and it might be useful to others.


As an existing user of Blue Nomad's BackupBuddyVFS Pro version 3 [BBVFS v3] I was interested in seeing if their newer version 4 was worth the upgrade charge. For me the headline changes were support for ZIP format archives, continuous backup when files change, and automated checkpointing.

With a background in IT security, I know that backing up and archiving data is an important task and, indeed, BBVFS v3 has saved me many times. As I like to test new software, the option to rollback and wipeout an erratic application is important. It has also helped in managing the occasional switch to new, or old, devices.

One thing that BBVFS v3 was less good at was saving multiple snapshots of the backup: creating permanent checkpoints being a manual action. A BBVFS checkpoint is a saved backup set that doesn't get updated again: it allows users to have saved, known configurations of their Palm.

Since I was looking to upgrade I decided to checkout other applications. I had previously tested other applications before purchasing BBVFS v2 and didn't have time to test everything again. So, as a satified user of a number of Resco's Palm applications, I decided to look at Backup v1.

The Comparison

The comparison was performed with these applications:

  1. Resco Backup v1.40.7, provided by Resco.
  2. BackupBuddyVFS v4.1, in evaluation mode (which is fully functional)
  3. BackupBuddyVFS v3.4.1.5, my legacy solution.

The test device was a Palm Tungsten T3 with a SanDisk Ultra II Plus 1GB and a standard ByteStor 512KB SD card [my dedicated backup card].

While the T3 is not the newest Palm, both applications include options that are specific to newer PIM and NVRAM based Palms.

I've colour coded the review:

  • Green:
    • Provides feature.
    • Provides feature and is the best implementation.
    • Good comment.
  • Yellow:
    • Provides feature partially.
    • Provides feature but is not the best implementation.
    • Comment that is neither good nor bad: ambiguous.
  • Red:
    • Does not provide feature.
    • Critical comment


Selecting files to backup
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Multiple backup file sets? Yes

The file selection is set for each 'Project'

Yes

File sets are can be assigned to one of the 5 available backup triggers

Yes

All files or 1 user defined selection.

File set can be assigned to one of the available backup triggers

Automatically selects all files Yes Yes Yes
User definable file set Yes Yes Yes
Automatically add new files to the user selection No

New files are only added if the user selection is All files.

Yes Yes
User definable set of file using a filter Yes No No
Automatically add new files to filter results Yes

Filter set can be static or dynamically set during the backup session.

No No
Global excluded files Yes Yes No
Global locked files Yes Yes No
Supports multiple HotSync ID users

[Useful for shared backup cards or sharing a card between multiple devices]

Yes

There is only one main backup folder on the SD card and this holds all the 'Project' folders. Each backup folder within a project's folder is name: {Hotsync ID} {Timestamp}

This allows for multiple users to share the same project settings. Each users is allocated the number of backup sets defined in the project settings.

Yes

Each hotsync user gets their own folder with in the main BBVFS backup folder on the card. The user's folder holds sub-folders for all their checkpoints, archives and backed up files

Yes

Each hotsync user gets their own folder with in the main BBVFS backup folder on the card. The user's folder holds sub-folders for all their checkpoints, archives and backed up files



Backup device/RAM options
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Backup RAM Yes Yes Yes
Backup Flash drive folders Yes No No
Backup SD/MMC card folders Yes No No



Compressing backups
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Supported? Yes Yes Yes
Compression levels? Yes

1. Normal
2. Maximum
3. Fastest

Yes

1. Quickly
2. Thoroughly

Yes

1. Quickly
2. Thoroughly

ZIP Yes Yes No
Other No Yes Yes



Encrypting backups
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Supported? Yes Yes Yes
ZIP

[Note: do not use the same password for ZIP encryption as for other stronger encrypting applications, as their effective encryption strength will be exactly that of the ZIP encryption]

Yes

Is this sufficient to protect personal data?

Use of password/data protection applications should be considered, such as one using AES, IDEA etc.

Yes

Claimed to be weaker than their Non-Zip based compression backup scheme

No
Other

[Still wise not to use the same password as used for other application: a 56bit key is not as secure as 128 / 1024 / 2048bit]

No Yes

XTEA ECB with 56bit:claimed to be better than ZIP, but effective strength is unknown.

Yes

TEA ECB with 56bit:claimed to be better than ZIP, but effective strength is unknown.



Archiving files no longer in RAM
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Able to opt to save files in backup set that are no longer in RAM Yes Yes Yes



Scheduling backups
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Supported?

[With multiple schedules / triggers it is still wise to plan to have only one triggering action for a given scenario]

Yes

The following are set for each 'Project', so multiple backup schemes can be active and gives a flexible approach to backup strategy: for example, this allow for an incremental, uncompressed snapshot triggered by exiting important apps, incremental, compressed daily backups for the previous week, and a full, compressed backup every week. Giving 9 'Backup Sets' with known data configurations.

Yes

There is only one backup scheme active at any one time, that can be activated by many triggers. Backups are normally incremental, with full backups being performed only after a 'Checkpoint' event. 'Checkpoint' events can be automatically triggered, but they may happen at unwanted times.

Yes

There is only one backup scheme active at any one time, that can be activated by many triggers. Backups are normally incremental, with full backups being performed only after a 'Checkpoint' event. 'Checkpoint' events are manually triggered,

Number of schedules supported Unlimited?

A schedule is a 'Project' and each defines the files on which it works and the triggers that kick-off the backup: as such, 'Triggers' are local to each 'Project'. Files are backed up to the / PALM / Backups / {Project Name} / {Backup Set folder}

1

Each trigger is global but can be assigned to backup a different user defined 'Set' of files to the common / Palm / Backup / {Hotsync ID} / Backup folder

1

Each trigger is global but can be assigned to backup a different user defined 'Set' of files to the common / Palm / Backup / {Hotsync ID} / Backup folder

Trigger on set time of selected days of the week Yes No No
Trigger on set time on all days Yes

Just select all days in the above feature

Yes Yes
Trigger when power button pressed to switch off unit No Yes

Activated when the global trigger is enabled or if a power-off is performed when a 'Continuous Backup' application is active

Yes
Trigger when selected applications exit

[It is best to limit this to a select few application as it can quickly become very annoying]

Yes Yes

Globally set with 'Continuous Backup'. This sets the files which activate this trigger

No
Trigger after HotSync Yes Yes Yes
Trigger before HotSync Yes No No
Trigger if no HotSync in a set elapsed time No Yes

The wait time is set between 1 minte and 99 days 23 hours and 59 minutes. The trigger repeatedly actives between HotSyncs.

Yes

The wait time is set between 1 minte and 99 days 23 hours and 59 minutes. The trigger repeatedly actives between HotSyncs.

Trigger repeatedly for selected days of the week Yes

A repeating period can be set between 1 and 12 hours

No No
Trigger on set threshold of low battery power No Yes Yes
Incremental backup supported Yes Yes Yes
Automated incremental backup Yes

A 'Project' is set to be 'Update' backup

Yes

Backups are incremental except when a defined 'Checkpoint' threshold is actived

Yes

All backups are incremental

Automated full backup Yes

A 'Project' is set to be 'Full' backup

Yes

A full backup is performed after a 'Checkpoint' is saved

No

Only full on first use.

Multiple backup snapshots? Yes

Each 'Project' can be set to save an unlimited or a defined number of 'Backup Sets'. The backup sets are cycled, if a defined limit of sets is specified, so that, when the maximum number of sets have been created, the oldest set is used for the next backup session. These are either incrementally maintained 'Update' sets that build on the older backup session files or a completely new 'Full' backup is performed after deleting the old backup's saved files.

With incremental backups, the impact is to minimise the disruption to the user while maintaining multiple, historical versions of the the selected files from the RAM: a 'Full' backup can be very time consuming.

Yes

'Checkpoint's of the current backed up files can be manually created or automatically triggered to happen every N days and/or N backups. The number of 'Checkpoint's can be limited by the user if required. The space used by 'Checkpoint' folders can be limited to a set value of MB.

During a 'Checkpoint' event it seems that the backup folder is renamed with a timestamp and then a new empty backup folder is created. This forces that full backup is performed after the 'Checkpoint' and depending on the trigger (such as N backups) this could be at an inconvenient time.

Yes

'Checkpoint's of the current backed up files are manually created.

During a 'Checkpoint' event it seems that the backup folder is renamed with a timestamp and then a new empty backup folder is created. This forces that full backup is performed after the 'Checkpoint'.

Listing type File 'explorer' listing with sorting based on file parameter, such as: name, date, creator, size etc Tree listing with files listed by creator: either shows the associated application name or creator ID if not known. Sorted list by name
Select incremental Yes No No
Select full Yes No No
Select groups of files by application using single click No Yes

Tree-viewing allows the selection of the application which selects all of that creator ID's files.

No



Browsing files and lists
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Listing type File 'explorer' listing with sorting based on file parameter, such as: name, date, creator, size etc Tree listing with files listed by creator: either shows the associated application name or creator ID if not known. Sorted list by name



Manual backups
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Supported? Yes Yes Yes
Select incremental Yes No No
Select full Yes No No
Select groups of files by application using single click No Yes

Tree-viewing allows the selection of the application which selects all of that creator ID's files.

No



Restoring files
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Full restore Yes Yes Yes
Selected file restore Yes Yes Yes
Select groups of files by application using single click No Yes

Tree-viewing allows the selection of the application which selects all of that creator ID's files.

No
Requires encryption password to be entered before the restore? Yes No

Tries to use the saved password.

No

Tries to use the saved password.

Using the stored password is convenient but it does bypass the protection provided by the encryption in the situation where an unlocked Palm and card are mislaid.

The better solution would be to allow the user to decide if the stored password is to be tried during restore: this would have to be an option on the dialog screen used to type in the password, and not a generally accessible option.

Initial restore file selection All

Defaults for a full restore.

Previous selection

The previously selected files are still selected. For a partial restore, this could be an issue if they are not visible in the list window. It is advisable to always do a 'Select None' first and then select the files to restore.

Previous selection

The previously selected files are still selected. For a partial restore, this could be an issue if they are not visible in the list window. It is advisable to always do a 'Select None' first and then select the files to restore.

Other notes The 'Restore' dialog window and 'Next >' button at first looks like it is only a full restore. The window and button could be renamed to imply that it is pre-restore activity, which will lead to a file selection screen.

Restore from multiple backup snapshots during a single restore event Yes No No



Other features
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v3
Verify backup integrity Yes No No
Compare backup snapshots differences Yes No No
Easy for novice users? No

There is no 'basic' mode that allows new users to bypass the more advanced options and concepts of backing up.

There are New Backup and Restore…buttons, but also an Update button. Plus others for Verify, Setup, Sets, and Schedule.

A basic mode should allow a new user to instantly understand what to do, and so make a first backup 'now'. Then there is time to learn about other features.

The most important thing is to do backups [and be able to restore from them, too]; an easy entry to do a first backup is essential so as not to frighten away users.

Yes

Basic and Advanced user modes.

The Basic mode is equivalent to the 'lite' version of BBVFS. This gets any user backing up straight away with the big Backup button - almost impossible to go wrong. There is a button for accessing Preferences [schedules, and compression and encryption] and another for a full restore.

Advanced mode provides access to archiving, checkpoints, backup sets, partial backup/restore.

Yes

Basic and Advanced user modes.

The Basic mode is equivalent to the 'lite' version of BBVFS. This gets any user backing up straight away with the big Backup button - almost impossible to go wrong. There is a button for accessing Preferences [schedules, and compression and encryption] and another for a full restore.

Advanced mode provides access to archiving, checkpoints, backup sets, partial backup/restore.

Support for newer Palms Yes

Caters for newer Palms with options to set excluded files, and address various PIM and NVRAM specific issues related to backing up: DbCache, newer PIM DBs, locking risky apps.

These options are useful but time is needed to understand which are most appropriate for the user's Palm.

Yes

Caters for newer Palms with excluded files and locking risky apps.

This is overtly more appropriate to newer devices than V3, whether this is truly the case or not, it would be better to use V4 for peace of mind.

Possibly

No specific options to cater for newer Palms: though many updates have been issued since its release, it is possible that many issues are addressed without need to have user options.

No locking of risky apps nor an excluded files list.

Price $14.95 $24.95

Upgrading V3: $11.95

No longer available



Comparative Performance
Feature Resco Backup v1 BBVFS Pro v4 BBVFS Pro v4
Settings ZIP ZIP Proprietary Compression & Encryption
Application size 191KB 627KB 627KB
Tests with ByeStor 512KB SD card
Full backup (KB) - Best 'Maximum' compression with encryption and computing CRC 'Thorough' compression with encryption Not performed
09:27 minutes 16:26 minutes --
12,700KB 12,831KB --
Full backup (KB) - Fastest 'Fastest' compression with encryption 'Quickly' compression with encryption 'Quickly' compression with encryption
05:38 minutes 15:48 minutes 17:10 minutes
13,798KB 13,371KB 15,693KB
Tests with SanDisk Ultra II Plus 1GB SD card
Full backup (KB) - Best 'Maximum' compression with encryption and computing CRC 'Thorough' compression with encryption Not performed
05:50 minutes 06:46 minutes --
12,700KB 12,831KB --
Full backup (KB) - Fastest 'Fastest' compression with encryption 'Quickly' compression with encryption 'Quickly' compression with encryption
02:08 minutes 06:06 minutes 10:28 minutes
13,798KB 13,371KB 15,693KB
The tests where performed as full backups of the same RAM (30,520KB containing 721 files) and, before performing a new test, the backup files of previous tests were deleted to bring the card state back to the pre-test structure. All encryption was performed using the same password.

The Resco Backup timings are based on the time reported by the application [I checked and verified that they reported the times as stamped in the backup folder and its files]. For BBVFS I used the first backed up file's creation data and the last backed up file's modification time and calculated the elapse time: this omits the time for checking for orphan files, which is an unnecessary activity in full backups.

Note: Tests are specific to the composition of files resitent in RAM, the Palm device, and the SD card used. Tests on other environments will yield different results.

VFSMark Results for ByteStor 512KB SD Card used in the tests:

  • File Create: 50%
  • File Delete: 29%
  • File Write: 6%
  • File Read: 760%
  • File Seek: 1475%
  • DB Export: 29%
  • DB Import: 953%
  • Record Access: 905%
  • Resource Access: 853%

      VFSMark: 562

VFSMark Results for SanDisk Ultra II Plus 1GB SD Card used in the tests:

  • File Create: 163%
  • File Delete: 141%
  • File Write: 109%
  • File Read: 760%
  • File Seek: 1311%
  • DB Export: 54%
  • DB Import: 811%
  • Record Access: 905%
  • Resource Access: 853%

      VFSMark: 567

Tests where also performed without any compression at all, and for both applications these tests were significantly slower than the results with compression. As such I will be backing up with compression switched on.


Comments


I performed backups and restores, full and partial, and both performed well. The success of recreating a working Palm was demonstrated by both.

The a summary of the unique benefits of each application is given below.

Resco Backup Plus points

  • Speed of backup.
  • Much better implementation of multiple backup snapshots/sets: BBVFS v4 needs to perform a full backup after a checkpoint is why I never used them [manual action in v3] as the time was too onerous.
  • Selectable incremental and full backups instead of forced full only after checkpoint.
  • Different compression settings for quick snapshot projects and higher compression and comparison checking for less frequent backup projects.
  • With the scheduled options to hide the count-down and abort button the dialog is nice and small and seems to be an integral part of the system.
  • Backup projects can be associated with named SD cards, so stopping unwanted backing up to swapped out cards.
  • Relatively small application size.

BackupBuddyVFS Pro v4 Plus points

  • Ease of use for novice users: BBVFS has a lot less 'advanced' settings for newer Palms on display, in fact only locking 3rd party apps is shown: BBVFS must address other new Palm issues under-the-hood?
  • Supports stronger encryption backups, and weaker PC compatible ZIP encryption: RescoBackup is only ZIP. Relative strength is unknown: how difficult is [X]TEA 56bit to brute force?
  • Tree-view is useful for easily selecting multiple files associated with an application - this isn't fool-proof as some software authors use other creator IDs to obscure files from users.
  • Scheduling triggers for manual power-off, low battery and time since last hotsync are only available in BBVFS.
  • Maximum space for backup sets useful for shared-usage/smaller cards.
  • Restores without password prompt - but the ability to do this should be an option set when storing the password.
  • The main screens are visually better: especially now with the coloured tree view.
  • Scheduled backups have countdown and re-schedule dialog, and not for continuous backups. More user-friendly than having the dialog for all or no backup events.
  • Option to add new files to user defined file sets.


Conclusion

Having looked at both applications I'm convinced that they are both worth using. While they both aim to address the needs of advanced users there are significant differences that leave me believing that BackupBuddyVFS Pro is more appropriate for novice users and users that don't require Resco's more advanced support for multiple backup sets. BBVFS v4 has support for user defined file sets but these are always applied to the current, single backup folder, whereas Resco Backup allows multiple backup folders to be active so giving concurrent backups for, e.g., this morning, yesterday, last sunday and so recovery - and all these can be maintained as incremental backups.

If I were to create a simple, dedicated manual backup SD card for supporting multiple users [paid of course] then BBVFS would be my choice: making a copy of the app as /PALM/start.prc so that it runs on card insert, or using the InsertSD system extension. The big basic mode 'Backup' button is so easy. The full and incremental backup options in Resco Backup would tip it for a backup card for advanced users.

However, the performance difference, is very marked and may lead users to not perform frequent BBVFS checkpoints. From my experience, we were always told to do daily backups for each day of the week, rotated each 7 days, then keep each weekly backup for a month and then archive and retain the monthly backup. This might be over-kill for a Palm but support for a modified scheme would be useful. If the time impact of creating multiple backups is too onerous then users may put off performing them: so it is strongly recommended that a fast SD card is used with any backup application.

Both vendors provided a comprehensive user guide, on their websites, and users should read these while evaluating the applications. Much of what might seem complex is explained in the guides and, having done so myself, leads to a more thorough understanding of how the applications work and can best be used. Additionally, both applications included useful built-in help too: BBVFS omitted details for some of the newer features.

With either application I would strongly advise that users use a stronger encryption solution for securing their most important data, as the relative strength of ZIP and TEA will probably be not sufficient. Currently I use SplashID with Mac desktop and it has proven to be a stable solution, provided it is properly backed up along with all my other data! Just remember that, just like any other piece of technology, SD cards can fail, so it is best to backup to more than one card and/or backup the SD card to another location (Mac, PC, CD etc).

So what have I decided to do?

Having seen the both in action I have decided to move to Resco Backup for my automated backup solution as it provides comprehensive support for concurrent backup schemes with faster backups; users wishing to stay with BBVFS should consider updating to V4 for the automated checkpoints and ZIP speed improvements.

The ByteStor SD card is now my dedicated backup card. It has both BBVFS v3 and Resco Backup installed and I'm keeping manual backups using both applications: BBVFS v3 has been there for me many times and I'm reluctant to dismiss it. The card will remain at home and is my data insurance policy, along with HostSyncing to Missing Sync, just in case something happens to my Palm.


Notes

Resco kindly provided a licenced copy of Backup. However, the review was performed for my own benefit and as such it was performed objectively as I don't want to lose my data.

Both Resco and Blue Nomad have expressed interested in this review and seem keen to see to how they can improve their products, which can't be a bad thing for us users!