geminispace.info

commit 64748f085254199e38203f84844201ac88aa27e7
parent 95e29af321164f011da5dc5a77e3a01e662799ac
Author: René Wagner <rwagner@rw-net.de>
Date:   Fri, 12 Feb 2021 08:53:20 +0100

add verbose search to robots.txt

This was missing in the first place.

Diffstat:
M
serve/views.py
 | 
1
+

1 file changed, 1 insertion(+), 0 deletions(-)
diff --git a/serve/views.py b/serve/views.py
@@ -63,6 +63,7 @@ def status(request):
             """User-agent: researcher
 User-agent: indexer
 User-agent: archiver
+Disallow: /v/search
 Disallow: /search
 Disallow: /backlinks