EMAILER COMPARISON REPORT

Prepared By

Greg Andersen - E-Mail: andersen@cpsc.ucalgary.ca
Guy Bailie - E-Mail: bailie@cpsc.ucalgary.ca

February 21, 1996

TABLE OF CONTENTS

Executive Summary

Evaluation Criteria

Analysis of cc:Mail

Analysis of Word Perfect Office

Analysis of MS Mail

Conclusion

This report was prepared for CPSC 547 in order to fulfill the requirements of project 2. GGC is a fictitious consulting firm created for the purpose of preparing a software comparison report. Although GGC and company "A" are not real companies, the software comparison data is actual numbers based on trial usage by the writers.

GGC does not guarantee accuracy, adequacy or completeness of the services provided in connection with this report. GGC MAKES NO WARRANTIES, EXPRESS OR IMPLIED, AS TO RESULTS TO BE OBTAINED BY ANY PERSON OR ENTITY FROM USE OF THE CONTENTS OF THIS REPORT. GGC MAKES NO EXPRESS OR IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE OF ANY PRODUCT MENTIONED IN THIS REPORT.

EXECUTIVE SUMMARY

[TOC]

Company "A" requested that GGC perform an evaluation on the effectiveness of the software products CCmail , Word Perfect Office and MSmail which will be running in Windows for Workgroups 3.11.

GGC tested the products using preset Evaluation Criteria . These criterion consisted of Administration, Future enhancement capabilities, Ease of use, and some Miscellaneous criteria. Each one of these guidlines contained subheadings which were assigned an importance weight from which the system was then graded.

cc:Mail Results

GGC concludes that cc:Mail offered the most benefit from the Administration standpoint. This means that overall, cc:Mail was the easiest to support from a Network support point of view. Although cc:Mail did not score the highest overall for Ease of Use, it scored high enough to be a contender. For the networked office environment, cc:Mail would be the best choice. Overall, cc:Mail finished in second place behind Word Perfect Office.

Word Perfect Office Results

In the Word Perfect Office environment, Ease of Use was the highest scoring category. From a stand alone point of view, it was the clear winner. It fell behind in the Administration category however, proving much more difficult to support than cc:Mail. Word Perfect Office showed the highest overall score.

Microsoft Mail Results

Lastly, Microsoft Mail scored the same in the Ease of Use category as cc:Mail, but registered the worst Adminstration score of the three. For obvious reasons, it was the hands down winner in the MS Office compatibility category which would make it the clear choice in a stand alone environment having MS Office in use. Overall, Ms Mail produced the lowest score of the three.

OVERALL SCORES

Rating: Score:
Wt. WPO MSMail cc:Mail WPO MSMail cc:Mail
Administration 10 7.00 5.00 10.00 70 50 100
Network 10 8.00 7.00 10.00 80 70 100
Training 8 10.00 10.00 8.00 80 80 64
Ease of use 10 10.00 8.00 8.00 100 80 80
Rules 7 10.00 9.00 5.00 70 63 35
Cost 6 10.00 8.00 8.00 60 48 48
Vendor Support 8 8.00 10.00 10.00 64 80 80
Average Rating: 9.00 8.14 8.43
Total Score: 524 471 507

EVALUATION CRITERIA

[TOC]

The purpose of this study was to compare and contrast 3 popular MS Windows based email systems. In order to make a fair assessment of the systems, criteria was decided upon that would carry a weight related to its importance as a feature. Each feature could then be rated by the user and given a score between 0 and 10, where 0 indicates a poor rating and 10 represents an excellent rating. These rating sheets were then distributed to the pilot group who tested all 3 systems based on these features. It should be noted that the Administration features were only rated by the information systems subjects.

The criterion used along with their respective features were as follows:

ADMINISTRATION

The administration features were designed to give an indication of how complicated it would be to implement and maintain the system. The features for this category were:

  • Rules
    This criteria gives a rating of how many administrative rules are needed to set up the mail system from an administration level, and how easy they are to use. Importance Weight = 10
  • Administration Tools
    This criteria rates how well the product can be maintained by the use of the administrative tools offered by the product.Importance Weight = 10
  • Read Network Bindery
    This criteria is used to show how effective the product is in connecting with existing networks, such as Novell Netware, or other. Importance Weight = 9
  • High-Level Security
    This criteria rates the product on how secure the administrative tools are from the rest of the network. Importance Weight = 6
  • Limits on Message Size
    This criteria rates the products on their abilities of letting the administrator have control over the limits on message size. Importance Weight = 5
  • Limits On Copies
    This criteria rates the products on its ability to have the administrator limit the number of copies of messages.Importance Weight = 5
  • Delay Message Delivery
    This criteria rates the email products on the delay time for delivering messages to users. In other words how long do messages sit in the mail queue, and its ability to be set by the administrator. Importance Weight = 6
  • Auto-Delete By Date
    This criteria rates the products on how they handle ‘stale’ messages, i.e. wn do outdated messages get deleted, and can this be set by the administrator. Importance Weight = 9
  • Global Distribution Lists
    This criteria rates the products as to whether global mailing lists can be set up or not and how easily the administrator can do this. Importance Weight = 10
  • Future:

    The future features were designed to evaluate potential up coming needs or services which could be easily added on when required. The features for this category were:

  • Scheduling
    This feature allows for individual schedules to be coordinated with others for arranging meetings and / or conferences. Importance Weight = 7
  • Bulletin Boards
    This feature allows the user to communicate with the various BB's available today. Importance Weight = 9
  • Discussion DB's
    This feature allows the user to join a discussion group where they can communicate with other memebers of the group when it is convenient for them to do so. Importance Weight = 5
  • Multi-media
    This feature looks at the multi-media capabilities of the system. Importance Weight = 5
  • Runs on Unix
    This feature would allow the system to run in the Unix environment as well as MS Windows. Importance Weight = 7
  • EASE OF USE

    The ease of use features were designed to give an indication of how user friendly the system was. The features for this category were:

    Creating a Message

  • Looking Up Addresses
    Rates on how easy the product is to retrieve an address from a global mail list. Importance Weight = 10
  • Formatting Message Text
    Rates on an number of different criteria pertaining to the message text of mail messages. Including such things as wrap-around text, standard font sets, etc. Importance Weight = 9
  • Spellcheck
    Rates on whether or not the products include a spell checking tool or not and how effective and easy to use it is. Importance Weight = 8
  • Thesaurus
    Rates on whether or not the products include a thesaurus tool or not and how effective and easy to use it is. Importance Weight = 8
  • Saving Message As a Draft
    Rates the mail products on the ease of ability to create a message and save it as a draft copy before sending it. Importance Weight = 10
  • Carbon Copies
    Rates the products on how easily it is to send duplicate copies of the same message to other people. Importance Weight = 5
  • Printing The Message
    Rates the products on their ability to print a message, both on how easy it is to do and the resulting print. Importance Weight = 8
  • Attaching A File
    Rates on how easy the application can attach a file of any type to the existing outgoing mail message. Importance Weight = 10
  • OLE

    Rates the ease of linking objects within the given environment.

  • Cut/Paste From Other Apps
    Rates the product on it’s ability to take a piece of information from some other application and place it in the existing mail message using cut and paste procedures. Importance Weight = 10
  • Auto Copy Of Message To Folder
    Rates the product on whether or not it automatically makes a copy of your outgoing message to a folder for you. Importance Weight = 8
  • Sending The Message
    Rates the mail products on their ease of sending a message. Importance Weight = 10
  • Getting A Receipt Back
    Rates the applications on whether or not they send you back a confirmation that the mail message has been sent, or how easy this option is to set up. Importance Weight = 8
  • Receiving a Message

  • Replying To A Message
    Rates the applications on how easy it is for a user to reply to a message that has been received. Importance Weight = 10
  • Forwarding A Message
    Rates the applications on how easy it is for a user to forward a received message to other individuals on the mailing list. Importance Weight = 9
  • Resending A Message
    Rates the applications on their ability to take an already sent message and resend to the same person, and how easily this can be performed by the user. Importance Weight = 8
  • Deleting A Message
    Rates the application on it’s method of deleting messages from the users mail folders. Importance Weight = 9
  • Retracting A Message
    Rates the application on whether or not it is able to get a message back after it has already been sent and how easy this can be done. Importance Weight = 5
  • Searching Messages
    Rates the applications on their ability to search through all messages for some search criteria. Importance Weight = 4
  • Sorting Messages
    Rates the applications on the ability to sort all messages in a specified order and how easy and effective this is done. (e.g. by date, alphabetic, message importance, or combination of). Importance Weight = 5
  • Reading Attached File In Mail Without Loading Application

    Rate the products ability to read an attachment from another application without physically loading the application.

  • Copying A Message To A Folder
    Rates all applications on how easy it is to copy a message into a specific folder and how easy it is to create folders. Importance Weight = 5
  • Miscellaneous:

    The miscellaneous features were designed to evaluate those features that didn't readily fit into one of the othe categories. The features for this category were:

  • On-Line Tutorial
    This feature allows for the user to see how the system works via an integrated on-line tutorial. Importance Weight = 8
  • DOS Interface
    This feature allows the user to access the system from the DOS prompt if Windows were not installed on their machine. Importance Weight = 10
  • Message Tracking (Work Flow)
    This feature allows the users to share projects where a message can be started by one user and passed to the next user for their input. The location of who currently has the message can be tracked for easy communications. Importance Weight = 9
  • Archive to C Drive
    This feature allows the user to archive their messages on the hard drive in personal folders. Importance Weight = 7
  • Vendor Support
    This feature looks at the ease at which support can be obtained by the vendor. Importance Weight = 8
  • Nicknames
    This feature allows for the user to create nicknames or aliases for their recipients. Importance Weight = 6
  • Creating a Folder
    This feature allows the user to create folders for messages that are related to one another. Importance Weight = 7
  • Absence Message
    This feature allows the user to create an extended absence message which would notify all senders to his / her mail box that they were not available to receive mail. Importance Weight =10
  • Secondary Users
    This feature allows for the user to assign another user to read/reply to their mail in the event of absence by the user. Importance Weight = 10
  • Create Forms
    This feature allows the user to create specialty forms which could be stored and used as templates by other users. Importance Weight = 2
  • Rules Creation by User
    This feature allows for the creation of user defined rules. Importance Weight = 10
  • Private Distribution List
    This feature allows for the user to build distribution lists for frequently mailed groups of people so as to avoid inputting several email addresses every time a letter is sent to that group Importance Weight = 10
  • User Exclusion
    This feature allows for the user to exclude individual users from a distribution list while still being able to keep their address as part of the list. Importance Weight = 8
  • MS Office Compatible
    This feature looks at the compatibility between the email system and Microsoft Office tools. Importance Weight = 7
  • The Results Tables accompanying the analysis show the results for the respective email systems along with a score for each feature. The score value is calculated by multiplying the rating by the weight. The rating values are the average of all the test subjects involved in the study rounded up or down to the nearest integer between 0 and 10 accordingly. The score is calculated using all the raw data and then rounded at the end. This explains why the score may not be exactly equal to the rate times the weight.

    ANALYSIS OF CC:MAIL

    [TOC]

    CC:Mail performed well in all the categories but clearly stood out in the Administration category. Although it did not score the highest in the Ease of Use category, it still managed to get a respectable score. It also scored well on several of the features which were heavily weighted in the Future and Miscellaneous categories. The results can be viewed in the cc:Mail Results Table

    ANALYSIS OF WORD PERFECT OFFICE

    [TOC]

    Word Perfect Office was more difficult to support from a network point of view, but was clearly the easiest to use. It excelled in the manipulation and handling of mail documents. The results can be viewed in the Word Perfect Office Results Table

    ANALYSIS OF MS MAIL

    [TOC]

    MS Mail was the most difficult to support from a network point of view, and rated very close to cc:Mail in the Ease of Use category. MS Mail's strongpoint was the compatibility with MS Office. This was very well received by users wanting to include Word and Excell attachments. The results can be viewed in the MS Mail Results Table

    CONCLUSION

    [TOC]

    cc:Mail had top marks in the Administration category which makes it an ideal candidate for network environments. It was not as user friendly as Word Perfect Office in terms of Ease of Use but it wasn't difficult to use by any means. cc:Mail lends itself to adding future enhancements, particularly, scheduling and discussion data bases. Microsoft Mail had a reasonably friendly user interface but lacked a little in the Administration features. It was this aspect which hurt MS Mail for this study. The overall winner of the three was Word Perfect's Office, which despite its lower score in the Administration category, produced the highest overall score. This was due to its superior user interface and document handling facilities.


    [ TOC | Executive Summary | Evaluation Criteria | Analysis of cc:Mail | Analysis of Word Perfect Office | Analysis of MS Mail ]