Revise robots.txt and add .htaccess to gitignore
authorBen Shum <bshum@biblio.org>
Sun, 3 Mar 2013 19:55:34 +0000 (14:55 -0500)
committerBen Shum <bshum@biblio.org>
Sun, 3 Mar 2013 19:55:34 +0000 (14:55 -0500)
Because we hate bots that kill our web server.

Signed-off-by: Ben Shum <bshum@biblio.org>
.gitignore
robots.txt

index ec5f705..594d636 100644 (file)
@@ -9,4 +9,4 @@ irc_logs/
 meetings/
 piwik/
 webalizer
-
+.htaccess
index 0d79b2f..8304288 100755 (executable)
@@ -2,3 +2,6 @@ User-agent: *
 Disallow: /bugzilla/
 Disallow: /dev/
 Disallow: /cgi-bin/bugzilla/
+
+User-agent: Ezooms
+Disallow: /