Test Plan (Draft 1)

Posted by fdiv_bug on June 23, 2006 Leave a comment (0) Go to comments

This is the initial plan for how and what I’m going to be testing on the hopefully forthcoming Sun Ultra 40.

Software Under Test

Ruby on Rails 1.1.2 (Ruby 1.8.4)
PostgreSQL 8.1.4
Apache 2.0.58
Lighttpd 1.4.11 (only on Solaris and Linux)
IIS 6 (only on Windows [duh] and if I can get it working right with Rails; I’ve had problems in the past)
SQL Server 2005 (also only on Windows)

Tests Run

Rails

A stress test suite of my own devising, called “baobab.” It runs some simple tests (like displaying the rails_info stuff) and some designed to mimic real-world performance needs:

Drawing a weekly calendar with several overlapping appointments.
Selecting 25 2048×1536 images from a database and scaling them to thumbnail sizes on the fly using RMagick.
Displaying a single image from the database, five times with image IDs 1-5.

Database

Not yet sure whether I want to craft my own tables and data set and have Apache JMeter run it, or if I just want to use OSDB.

Web Server

I’m going to craft several files of sizes ranging from 1KiB to 1MiB to 5GiB and use Apache JMeter to download the files as quickly as it can. I’ll likely thread the crap out of this.

Tools

Apache JMeter
OSDB (Solaris and Linux only, and I’m not sure about this one since JMeter can also test the database)

I’m going to continue to expand upon my test plan as I think of things to add, and will be adding more blog entries with subsequent drafts. On a less serious note, I’m still trying to decide what to name the system (assuming I do get it). I’m torn between ne-plus, from “ne plus ultra” and lotus, from the flower (not the IBM subdivision).