geminispace.info

commit d54e65a4cdea4f14390c395472da1ac498be28ea
parent 429b9d4de04bf8b95967cd7ad15ac46f2d751cbc
Author: Natalie Pendragon <natpen@natpen.net>
Date:   Sun, 15 Nov 2020 10:56:01 -0500

[crawl] Increase increment to temp error change frequency

The crawls seem to be spending too much time on these, and there seems
to be a steady stream of new ones that all look like a common word
followed by a common TLD. Each one of these causes a long-running,
ultimately failed DNS lookup, so it ends up taking a long time. This
change should help naturally filter them out of crawls more quickly.

Diffstat:
M
gus/lib/gemini.py
 | 
2
+-

1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/gus/lib/gemini.py b/gus/lib/gemini.py
@@ -351,7 +351,7 @@ class GeminiResource:
         elif category == "redirect":
             return existing_change_frequency + 24 * 2
         elif category == "temp_error":
-            return existing_change_frequency + 12
+            return existing_change_frequency + 24 * 3
         elif category == "perm_error":
             return existing_change_frequency + 24 * 30
         elif category == "prompt":