Bye bye cute robots :'(

Ask on Matrix to find out why this was necessary.
2020-02-23 00:14:20 +13:00
parent d6ee6c0411
commit 8b96638a0d
1 changed files with 4 additions and 2 deletions
--- a/src/site/html/robots.txt
+++ b/src/site/html/robots.txt
@@ -1,3 +1,5 @@
 User-Agent: *
-Disallow: /u/*page=
-Disallow: /fragment
+Disallow: /u/
+Disallow: /p/
+Disallow: /fragment/
+Disallow: /api/