Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

comment on

( [id://3333]=superdoc: print w/replies, xml ) Need Help??
Hi All,

I'm in the process of introducing/improving automated testing in our environment, and looking at how we run and monitor those tests.

Background

We have a public facing web infrastructure based on Apache and mod perl, and a core customer facing client/server Java application. Development is done in a dev/test environment, unit tested by the developer there, then deployed into Integration where UAT testing happens. Finally it's deployed into production where end users break the use cases and script kiddies demonstrate that they have far less destructive imaginations than Joe User ;-) As usual, most of the testing for the website is manual, although we have an increasing number of TAP unit tests (the Java team have CI already - see below).

Continuous Integration

My initial thought was to run my 'runalltestswithdevelcover.sh' script once a day, redirecting the html output to a webserver. I've got that basically set up, and it looks like a good start. It outputs some nicely HTML formatted TAP output courtesy of TAP::Formatter::HTML and Devel::Cover output. I'm also contemplating a spot of integration with CVS to show when tested files were last checked in as well.

But then one of our Java team mentioned continuous integration to me. I had a bit of a poke around in TeamCity (which the Java team use) and concluded that it would be really nice to integrate a CI system with our build process. The way I'm thinking, the overnight process becomes:

  1. Run build script
  2. deploy daily build to (an) integration server
  3. run unit tests and report output
  4. back out build
  5. run previous unit test set and report output

That would test not only the code, but the release/deployment process (subject to the limitations of automated tests of course) and the backout process too.

Incidentally this would probably entail a second integration server. The deployment process entails process controls on the integration environment, which is widely used outside our team so we can't risk regularly breaking it.

It would be a fairly time consuming and complex task to build this testing & CI infrastructure, and my initial idea is to do it gradually. The change plan would be:

  • Stage 1: a daily run in Dev of the existing unit test suite, outputting the results to TeamCity
  • Stage 2: build a 2nd integration server/VM and build the scripts to keep it in sync with the main integration server
  • Stage 3: get TeamCity running the build script daily, to ensure the build is successful
  • Stage 4: start deploying the build to the second integration server daily and recording the results
  • Stage 5: Before and after unit testing in integration as part of the process

To me it looks do-able, if a little time consuming, and likely to improve our release process significantly. I'd quite like to make the right choices before I start, so that I don't end up wasting a load of time on tools that won't do what I want. So:

  • Has anyone else built this kind of release infrastructure for a LAMP environment?
  • Will TeamCity work ok for this, or should I be looking at Smolder, or Hudson, or something else?
  • Anyone got any other suggestions/thoughts?

Thanks.

Charles.

Notes:

Suggestions on Deploying Perl Test Environment

TeamCity on CPAN

--------------------------------------------------------------

"If there is such a phenomenon as absolute evil, it consists in treating another human being as a thing."
John Brunner, "The Shockwave Rider".

--------------------------------------------------------------

"If there is such a phenomenon as absolute evil, it consists in treating another human being as a thing."
John Brunner, "The Shockwave Rider".


In reply to Continuous Integration in a LAMP environment by g0n

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post; it's "PerlMonks-approved HTML":



  • Are you posting in the right place? Check out Where do I post X? to know for sure.
  • Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
    <code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
  • Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
  • Want more info? How to link or How to display code and escape characters are good places to start.
Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others sharing their wisdom with the Monastery: (5)
As of 2024-03-29 11:53 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found