I did look at CPAN and found that the Net::Whois mod looks like it would work had it not be for the shear number of domains this will be ran on ( about 10,000 total ) so the issue I run into there is just exact timing. There was an issue sometime back where the whois DB servers we just getting spam'd with requests so in turn the whois companies ( Internic, register, NetSol ) all have put in place wrappers that only allow "X" amount of requests per min/sec. Now with that said I have to use the software provided by my partner ( register.com ) to run my whois. With their system I can run an unlimited number of whois requests without the wrapper taking control, so with that said the common CPAN mods aren't going to work unless anyone knows a catch 22 / loophole. | [reply] |
Do you know what "X" is? or have the time/patience to get close enough? If so, would it be unreasonable to have your script perform only a few at a time? You could catch the time at the beginning of the loop through the domains, and if it is going to fast, just pause the program for a while with a syscall. If you can't have the program running all day, just run it at night and keep track of which domains you have done already.
| [reply] |
