I've got a project that would benefit from spidering and scraping a web site. Unfortunately, the web site I want to spider and scrape has very explicit TOS and robots.txt: the info I want is off limits. I want to cancel this project because of this, but management is insistent. Is it ethical to spider / scrape a site that says to stay away? Are there any possible legal ramifications? Should I tell my boss where to put his data in this job market?