Mailing List Archive Project Test Plan

General approach to testing is to send various messages to the list archiver, and use the web pages to display the results

1. Test archiving
   1. Test archiving standard email
   2. Test archiving email without a subject
   3. Test archiving reply to subjectless email
   4. Test archiving minimal email (telnet host smtp)
   5. Test resending identical message (telnet host smtp)
   6. Archiving capacity load test
2. Test display of message
   1. Select several different messages, check display against database contents and mail saved in email client
3. Test searching for messages
   1. restrict date range
      1. Different date formats
      2. Valid dates with expected data
      3. Valid dates with no data expected
      4. limit only beganing and then limit only end of range
      5. Enter invalid dates but in valid format
      6. Enter dates in an invalid format
      
      For each of the following search tests - enter value with expected hit(s), and value without expected hit(s). Also check that messages are not displayed multiple times
   2. Search for specific subject words
   3. Search for specific senders
   4. Search for any header text not in subject or from - e.g., sending machine
   5. Search for any body text
   6. Search for text anywhere in message
   7. Enter garbage or huge search strings
4. Test sorting of message lists
   1. Sort messages by date default behavior
   2. Sort messages by sender
   3. Sort messages by subject
5. Test selection of message header display
   1. When no message is displayed, change setting
   2. When message is displayed, change setting
   3. Check each setting
   4. Check persistance of setting across netscape invokations

Archiving tests

	Test archiving standard email
Test Procedure		Expected Output		Results
Send mail to archiving address from standard email client, e.g., netscape or outlook		New message appears in database




	Test archiving email without a subject
Test Procedure		Expected Output		Results
Send mail to archiving address from standard email client, e.g., netscape or outlook, but send message with blank subject		New message appears in database, message has Subject header, and header is blank




	Test archiving reply to subjectless email
Test Procedure		Expected Output		Results
Send mail to self with blank subject. Reply to email, and include archiver address in reply list.		Message with subject of "RE:" is archived




	Test archiving minimal email (telnet host smtp)
Test Procedure		Expected Output		Results
Telnet to smtp port of host with archiver running. Send mail to archiver using only commands rcpt to, mail from and data, include no headers in body of message. Repeat with second message.		First message is archived with blank subject line. Second and all suceeding messages fail due to identical headers.




	Test resending identical message (telnet host smtp)
Test Procedure		Expected Output		Results
Telnet to SMTP port on the archiving host, and send the identical SMTP commands twice.		Only 1 message is saved in the database




	Archiving capacity load test
Test Procedure		Expected Output		Results
Create a script to mailbomb an address, repeatedly sending messages using some small unique info in the subject such as a counter. Set up at or cron to run multiple copies of this script to flood the mail archiving process		At some number of simultanious mail bombers, the machine becomes clogged to the point of uselessness.




	Select several different messages, check display against database contents and mail saved in email client
Test Procedure		Expected Output		Results
Send a test email to the archiver, check database tables to insure message sent is saved, find message in displayed message list, read it, and compare again against original message		Original message, database, and display all match

Searching tests

	Search by date range - Different date formats
Test Procedure		Expected Output		Results
Enter search restrictions with the date formats 'yyyy-mm-dd', 'mm/dd/yyyy', 'mon dd, year' in both start and end date field		insure displayed messages are properly date restricted




	Search by date range - Valid dates with expected data
Test Procedure		Expected Output		Results
Enter a date range restriction where messages matching that restriction are known to exist in the database		Messages known to match are displayed




	Search by date range - Valid dates with no data expected
Test Procedure		Expected Output		Results
Enter a date range restriction where it is known no messages exists		No messages are displayed




	Search by date range - limit only beginning and then limit only end of range
Test Procedure		Expected Output		Results
Enter only a starting date limitation and search, then enter only an ending date limitation and search		Messages are displayed from the starting date to the last message ; Messages are displayed from the first message up to the ending date




	Search by date range - Enter invalid dates but in valid format
Test Procedure		Expected Output		Results
Enter a known invalid date as a search restriction, such as the 31st of February		No messages are displayed and an error is displayed




	Search by date range - Enter dates in an invalid format
Test Procedure		Expected Output		Results
Enter garbage data as a date restriction; also enter a date in an invalid format		No messages are displayed and an error is displayed


For each of the following search tests - enter value with expected hit(s), and value without expected hit(s). Also check that messages are not displayed multiple times


	Search for specific subject words
Test Procedure		Expected Output		Results
Enter a word to search for, and specify "Subject" search		Messages with that word in the subject are displayed




	Search for specific senders
Test Procedure		Expected Output		Results
Enter a word to search for, and specify "From" search		Messages with that word in the "From" header are displayed




	Search for any header text
Enter a search word known not to be in any archived message's subject or from headers (Eg: sending machine) and specify "All Headers" search		Messages with that word in any header are displayed




	Search for any body text
Test Procedure		Expected Output		Results
Enter a word to search for, and specify "Message Body" search		Messages with that word in the message body are displayed




	Search for text anywhere in message
Test Procedure		Expected Output		Results
Enter a word to search for, and specify "Everything" search		Messages with that word anywhere in the message body or headers are displayed




	Enter garbage or huge search strings
Test Procedure		Expected Output		Results
Enter a very large string of randomly typed characters, and select "Everything" search		Search string is truncated, and only messages containing matching random garbage are displayed

Test sorting of message lists

	Sort messages by date default behavior
Test Procedure		Expected Output		Results
Display a list of messages, click on the "Date" link in the message list header		Messages are redisplayed ordered by date. Note behavior with dates from different timezones! I can't test this right now !





	Sort messages by sender
Test Procedure		Expected Output		Results
Display a list of messages, click on the "From" link in the message list header		Messages are redisplayed ordered by Sender, and by date within that sender

	Sort messages by subject
Test Procedure		Expected Output		Results
Display a list of messages, click on the "Subject" link in the message list header		Messages are redisplayed ordered by base subject (the subject without any leading "Re:'s"), and by date within that subject

Test selection of message header display

	When no message is displayed, change setting.
Test Procedure		Expected Output		Results
Click on the preference radio box to select a different setting when no message body is currently displayed, then select a message body for display		The message body is displayed with the new prerence setting




	When message is displayed, change setting
Test Procedure		Expected Output		Results
Click on the preference radio box to select a different setting when a message body is currently being displayed.		The message should redisplay with the new setting




	Check each setting
Test Procedure		Expected Output		Results
Select each radio button preference setting, displaying a message with each		Check that the message headers defabase in the database are the ones displayed for each setting




	Check persistance of setting across netscape invokations
Test Procedure		Expected Output		Results
Select a different preference setting and check that mail messages are in fact displayed with the new setting. Quit netscape, restart it, and redisplay a message body.		Message body is still displayed with chosen preference