Spurious 405 error


#1

Every month or so some webcrawler tries to fetch
http://physpics.com/iie337/
and receives a 405 error. As usual, it works fine for me and no other webcrawler has encountered an error. The usual pattern of errors is like this recent one, all with GET from 76.29.6.190:

405 /iie337/lecture17/
405 /iie337/
405 /iie337/
405 /iie337/lecture17/
405 /iie337/

The only mention of iie337 in the .htaccess file is this


#2

how about your robots.txt file? are you explicitly banning it?


#3

The robots.txt file is empty.

There are some rewrite rules that apply to all directories. No ther directory has generated 405 errors. The rules are:

# if directory, and if it has index.php, use it
RewriteCond %{REQUEST_FILENAME} -d
RewriteCond %{REQUEST_FILENAME}/index.php -f
RewriteRule ^(.*) %{REQUEST_FILENAME}/index.php [L] 

# if directory, and if it has index.html, use it
RewriteCond %{REQUEST_FILENAME} -d
RewriteCond %{REQUEST_FILENAME}/index.html -f
RewriteRule ^(.*) %{REQUEST_FILENAME}/index.html?%{QUERY_STRING} [L] 

# if want file.html and file.php exists, use the latter
# this   * h * i * d * e * s *   .html files that have a corresponding .php
RewriteCond %{DOCUMENT_ROOT}/$1.php -f   
RewriteRule ^(.*)\.html$ $1.php [L]

# if want .php which does not exist, and have .html, use the latter
RewriteCond %{DOCUMENT_ROOT}/$1.php !-f  
RewriteCond %{DOCUMENT_ROOT}/$1.html -f   
RewriteRule ^(.*)\.php$ $1.html [L]

The iie337 directory has no .php files, but does have index.html.