ActiveState also do a rather nice IDE, but its fairly expensive and needs a reasonably chunky computer.
If I found myself having to write Perl on a Windows system I would probably set course for Cygwin to get myself a decent shell (bash), although it is possible to get the job done with cmd (the shell that comes with Windows XP). Then I'd get myself a decent text editor. I'm pretty sure that Emacs is available through Cygwin, but Emacs is quite scary for a newbie. JEdit might be a good choice, it has many of the benefits of Emacs, but without the need to know weird key combinations.
Oh, and ActiveState have some documentation for getting started with Perl on Windows.