projects
/
Evergreen_Website.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
| inline |
side by side
(parent:
a5e1fec
)
Revise robots.txt and add .htaccess to gitignore
author
Ben Shum
<bshum@biblio.org>
Sun, 3 Mar 2013 19:55:34 +0000
(14:55 -0500)
committer
Ben Shum
<bshum@biblio.org>
Sun, 3 Mar 2013 19:55:34 +0000
(14:55 -0500)
Because we hate bots that kill our web server.
Signed-off-by: Ben Shum <bshum@biblio.org>
.gitignore
patch
|
blob
|
history
robots.txt
patch
|
blob
|
history
diff --git
a/.gitignore
b/.gitignore
index
ec5f705
..
594d636
100644
(file)
--- a/
.gitignore
+++ b/
.gitignore
@@
-9,4
+9,4
@@
irc_logs/
meetings/
piwik/
webalizer
-
+.htaccess
diff --git
a/robots.txt
b/robots.txt
index
0d79b2f
..
8304288
100755
(executable)
--- a/
robots.txt
+++ b/
robots.txt
@@
-2,3
+2,6
@@
User-agent: *
Disallow: /bugzilla/
Disallow: /dev/
Disallow: /cgi-bin/bugzilla/
+
+User-agent: Ezooms
+Disallow: /