raulmoyareyes/robot.txt

Created July 18, 2015 17:50

Star (1) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/raulmoyareyes/4ea98c6551d280cd7af3.js"></script>
Save raulmoyareyes/4ea98c6551d280cd7af3 to your computer and use it in GitHub Desktop.

Download ZIP

Revisions

raulmoyareyes created this gist Jul 18, 2015.

robot.txt

-Original file line number
+Diff line change
@@ -0,0 +1,12 @@
+    #
+    User-agent: *
+    Disallow: /cgi-bin
+    Disallow: /wp-admin
+    Disallow: /wp-includes
+    Disallow: /wp-content/plugins/
+    Disallow: /wp-content/cache/
+    Disallow: /wp-content/themes/
+    Disallow: */trackback/
+    Disallow: */feed/
+    Disallow: /*/feed/rss/$
+    Disallow: /category/*