# $Author: kenc $ # $Date: 2007/02/26 05:22:27 $ # $Name: $ # $Revision: 1.1 $ # $State: Exp $ # 2005-04-09 - created robots.txt file based on file not found errors in the apache error_log # 2006-02-25 - copied robots.txt file from mvpontheweb.com to stop errors in apache error_log # for all search engines, disallow only those directories, etc that are not appropriate for searching User-agent: * Disallow: /articles/ Disallow: /control/ Disallow: /CVS/ Disallow: /Check/ Disallow: /cookieLog/ Disallow: /dbLog/ Disallow: /docs/ Disallow: /HTMLArea-3.0-rc1/ Disallow: /images/ Disallow: /megaupload-1.45/ Disallow: /stats/