I want to add some key words to this so people can find it. Such as crawl webpages.

Try using the Spyder module from CPAN to help you spider or crawl web pages / web sites.