24-04-2025, 05:25 PM
(24-04-2025, 04:42 PM)Koen G wrote: You are not allowed to view links. Register or Login to view.Unless someone remembers a particular thread at the right moment, or someone successfully uses the limited search function (which presupposes knowing the exact term that was used in advance).
If there is a text/markup only dump of the forum available with thread/post ids, I think it's nowadays not very hard or very costly to create an embeddings based search, that would find relevant posts or threads based on semantical requests (no remembering of exact keywords required).
If you have a relatively powerful GPU (for example, a M1 MacBook), the pre computation of vectors can be done locally and then the search queries can be processed on a low end Linux server. This won't automatically cover new posts, but could provide a way to go through old threads on a given topic.
If needed, maybe I can help with the pre computation part, I think I can spend some time on this in the second half of May.
![[+]](https://www.voynich.ninja/images/collapse_collapsed.png)
