geminispace.info

gemini search engine
git clone https://git.clttr.info/geminispace.info.git
Log (Feed) | Files | Refs (Tags) | README | LICENSE

commit 2ebc1a844a7b569c8df6a402c3ea9c4b44be701b
parent 6e54e520144aea538eccf830b2985a41878f8899
Author: René Wagner <rwagner@rw-net.de>
Date:   Mon,  8 Mar 2021 18:59:09 +0100

news update 2021-03-08

Diffstat:
Mserve/templates/news.gmi | 9++++++++-
1 file changed, 8 insertions(+), 1 deletion(-)

diff --git a/serve/templates/news.gmi b/serve/templates/news.gmi @@ -1,8 +1,15 @@ {% include 'fragments/header.gmi' %} - ## News +### 2021-03-08 +The shady workaround is now in place - index updates won't block searches anymore. +This is even more important with the ongoing growth of geminispace - as of today there are more then 750 capsules we know about. + +### 2021-03-06 +I'm currently working on a workaround to avoid the index update blocking search requests. +Unfortunately i broke the index during this...need to be more careful when doing maintenance. + ### 2021-02-26 I've made some adjustments on how GUS/geminispace.info uses robots.txt. Previously we tried to honor the settings for *, indexer and gus user-agents. That didn't work out well with the available python libraries for robots parsing and GUS ended up crawling files it wasn't intended tto.