From: Ben Shum <bshum@biblio.org>
Date: Sun, 3 Mar 2013 19:55:34 +0000 (-0500)
Subject: Revise robots.txt and add .htaccess to gitignore
X-Git-Url: https://old-git.evergreen-ils.org/?a=commitdiff_plain;h=87126a15c28bc4d90e8517c07afd029d919615b8;p=Evergreen_Website.git

Revise robots.txt and add .htaccess to gitignore

Because we hate bots that kill our web server.

Signed-off-by: Ben Shum <bshum@biblio.org>
---

diff --git a/.gitignore b/.gitignore
index ec5f705..594d636 100644
--- a/.gitignore
+++ b/.gitignore
@@ -9,4 +9,4 @@ irc_logs/
 meetings/
 piwik/
 webalizer
-
+.htaccess
diff --git a/robots.txt b/robots.txt
index 0d79b2f..8304288 100755
--- a/robots.txt
+++ b/robots.txt
@@ -2,3 +2,6 @@ User-agent: *
 Disallow: /bugzilla/
 Disallow: /dev/
 Disallow: /cgi-bin/bugzilla/
+
+User-agent: Ezooms
+Disallow: /