Are you forking to handle the connection? Is it possible that you have the socket opened twice (once in the parent and once in the child)? That would explain why closing the child socket doesn't close the connection.

For an example of how to write a forking TCP server, have a look at the documentation for Net::TCP::Server.