P is for Practical | |
PerlMonks |
Batch Google URL Removal Scriptby pileofrogs (Priest) |
on Jan 22, 2010 at 01:26 UTC ( [id://818861]=perlmeditation: print w/replies, xml ) | Need Help?? |
Hi all! I just set up a new sourceforce project for a perl script I wrote and wanted to toot my proverbial horn here on PM. Need to submit a batch of URLS to Google's URL removal request form? Try tasty new http://urlremove.sourceforge.net. I'm a network admin at a community college. We recently had an adventure where some instructors thought it would be helpful to post student phone numbers on web pages. We took down the pages containing phone numbers, but the phone numbers were still showing up in google searches in the summary paragraph in the search results. Google will naturally re-spider those pages and remove the offending material from the search results, but we wanted to do it faster. Google has a form you can fill out to submit a URL and Google will try and spider that URL sooner. Unfortunately, it only accepts one URL at a time and is generally tedious. Since I had a whole batch of URLS I needed to remove, I decided rather than go insane submitting them all by hand, I'd write a perl script to do it for me with WWW::Mechanize. And, since I didn't find any other tools out there to automate this task, I went and put it on sourceforge. So, if you or anyone you know needs to submit a stack of URLs to Google's URL removal request form, give this script a try. And if you just like looking at other people's perl and giving advice, please take a gander and let me know what you think. Thanks PM! Thanks Perl! http://urlremove.sourceforge.net --Pileofrogs
Back to
Meditations
|
|