Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Smoke testing a CPAN distro

by creamygoodness (Curate)
on Jan 21, 2008 at 21:15 UTC ( [id://663432]=perlquestion: print w/replies, xml ) Need Help??

creamygoodness has asked for the wisdom of the Perl Monks concerning the following question:

Greets,

I'm looking to set up a smoke testing regime for one of my CPAN distros. I imagine that it could take the form of a script that performs the following sequence of actions:

  • Download a "latest" nightly tarball from a fixed URL.
  • Unpack the tarball, build the module and run the test suite.
  • Optional: run an additional script which runs each test file under valgrind (with a debugging Perl), screen-scraping valgrind's output to determine whether any memory leaks or errors occurred. (The distro in question uses XS, and this step is actually the primary motivation for setting up smoke tests.)
  • If any step fails, send an email report to e.g. mydistro-smoke@example.com.

That seems straightforward enough, but I wonder: has anyone solved this same problem in another way? I can imagine extending the regime, e.g. to provide benchmarking data.

--
Marvin Humphrey
Rectangular Research ― http://www.rectangular.com

Replies are listed 'Best First'.
Re: Smoke testing a CPAN distro
by kyle (Abbot) on Jan 21, 2008 at 21:34 UTC
Re: Smoke testing a CPAN distro
by dpavlin (Friar) on Jan 22, 2008 at 17:12 UTC
    I also waited for cpan-smoking solution in a box to start testing my modules. However, at last YAPC Europe I was enlightened that whole purpose of testing is to have your own different test configuration, and not yet-another-copy.

    This somehow makes perfect sense to me, since most valuable test reports are from different machines, not from different version of same testing environment.

    Somehow, I also promised to make CPAN testing site on qemu-neo1973, which I still didn't do :-)


    2share!2flame...

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlquestion [id://663432]
Approved by kyle
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others scrutinizing the Monastery: (4)
As of 2024-03-28 23:12 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found