Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re: How do I test a CGI program properly?

by Trimbach (Curate)
on Jan 07, 2002 at 18:27 UTC ( [id://136826]=note: print w/replies, xml ) Need Help??


in reply to How do I test a CGI program properly?

It sounds like you've got everything well in hand: you're asking the right questions, open to suggestions from your users, and willing to make whatever changes are required to your project. However, as far as "getting meaningful comments" from users I have this to say:

Users suck at testing and evaluating software.

It's been my experience that the user (and by "user" I mean "the target audience who will ultimately be using the widget in production") make really lousy testers. For the most part they don't know how to stress a program (making choices that the programmer didn't anticipate), or test outcomes (did the the program do what it was supposed to do?), or evaluate the program for completeness (is there something it should be doing and doesn't?) Doing these things takes a LOT of time, getting into a program, understanding what it does, working through scenarios, thinking through possibilities, etc. etc. This is a lot of work, and it takes a special kind of person with special kinds of skills from someone who is very meticulous and linear. In my experience very, very few people in the "user" category are like that, so although I do what you do and toss out new widgets for suggestions/evaluation/bugchecks I rarely get anything more useful than "Huh... looks like it works" which of course leaves the real "evaluation" to when the users are using it in production awhile, try to do X and find the program doesn't do X, or get irritated because function Y doesn't work, or works in a less than optimal way.

These days I still put out my programs for evaluation, but I realize that it's mostly just a formality, and that almost never will anyone spend the amount of time I need that would really be useful. The whole situation makes you very appreciative of the professional QA folks whose job it is to do what you want... it IS a real job, that most people simply don't have the skill or experience to do well.

So, well, good luck to you, but if I were you I wouldn't expect much. The good news is that with a development team of one it'll be relatively easy to make changes after the fact as time goes on after the widget is in production.

Gary Blackburn
Trained Killer

  • Comment on Re: How do I test a CGI program properly?

Replies are listed 'Best First'.
Re(2): How do I test a CGI program properly?
by dmmiller2k (Chaplain) on Jan 07, 2002 at 20:01 UTC

    ++ajt (for a good question) and ++Trimbach!!

    You're right, Trimbach. Users make lousy testers. This is generally because their perspective tends more toward the concrete results they seek, rather than the (what almost certainly appears to them to be) picayune level of detail necessary to adequately test an application (e.g., "Why would anyone want to do THAT?!?").

    Of course, the other side of that coin is, "Why doesn't XYZ work," where XYZ is some completely unanticipated sequence that no one, during development, bothered to mention that they sometimes do ("Oh, that'll NEVER happen ...(time passes)... Oh, except when ...").

    Nothing replaces solid regression testing, unfortunately, and without another pair of eyes (presumably connected to some form of brain, one would hope) it's difficult to code for users' making choices one didn't anticipate them making.

    Good luck to you.

    dmm

    You can give a man a fish and feed him for a day ...
    Or, you can
    teach him to fish and feed him for a lifetime

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://136826]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others goofing around in the Monastery: (4)
As of 2024-04-20 01:59 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found