Colorado Woman Sues To Hold Web Crawlers To Contracts

InformationWeek reported The Internet Archive, which spiders the Internet to copy Web sites for posterity (unless site owners opt out), is being sued by Colorado resident and Web site owner Suzanne Shell for conversion, civil theft, breach of contract, and violations of the Racketeering Influence and Corrupt Organizations act and the Colorado Organized Crime Control Act.

Shell is an idiot. If she does not want her site spidered, all she has to do is include a metatag that tells spiders not to index the page, and not to follow links within it.

Shell's site states, "IF YOU COPY OR DISTRIBUTE ANYTHING ON THIS WEB SITE, YOU ARE ENTERING INTO A CONTRACT," at the bottom of the main page, and refers readers to a more detailed copyright notice and agreement. Her suit asserts that the Internet Archive's programmatic visitation of her site constitutes acceptance of her terms, despite the obvious inability of a Web crawler to understand those terms and the absence of a robots.txt file to warn crawlers away.