As long as the webserver only listens on localhost, it will only be reachable via localhost. If you want it to be publically accessible, you will need to make it listen on www.myserver.com:

podwebserver -p 1234 -H www.myserver.com
[download]

(this is straight from Pod::Webserver. If you are using a different program, consider telling us, which program you use)

If you're ssh'ing into the box you can port forward something on your box across the connection and then connect to the forwarded port on your localhost; e.g. ssh -L 8020:localhost:8020 myserver.com and then when you hit http://localhost:8020 on your box ssh magic will happen. This of course presumes that your server is configured to allow port forwarding.

This also has the advantage of not having whatever you're running listening on an outside port (it's still just listening on localhost) so you don't need to be as wary that you're opening whatever up to the vagaries of the wild intertubes.

Edit: WRT the install location, check what perl -V:prefix says; things may have installed into a bin directory under that instead of where you think it was going to install. You can check what's there with something like ls $( perl -MConfig -lE 'say qq{$Config{prefix}/bin}' ) presuming a *NIX environment.

To view it remotely you will almost certainly have to modify the firewall on the server host. Talk to the sysadm of the server host about that. TCP/8020 is not likely to be open by default.