The following warnings occurred:
Warning [2] Undefined variable $can_link - Line: 6 - File: showthread.php(1658) : eval()'d code PHP 8.5.12 (Linux)
File Line Function
/inc/class_error.php 157 errorHandler->error
/showthread.php(1658) : eval()'d code 6 errorHandler->error_callback
/showthread.php 1658 eval




Templatic Voynich generator
#13
(05-06-2026, 04:39 PM)Labyrinthinesecurity wrote: You are not allowed to view links. Register or Login to view.interesting,.. which kind of metrics do you have in mind?

The one that Torsten Timm used: average edit distance between all words of different lines. See the comparison with other texts here: You are not allowed to view links. Register or Login to view.
I guess there should be no detectable effect (local inter-line similarity) on your generated text.

I wrote a babble detector very recently based on Byte Pair Encoding, not optimal compression I know, so the results are a bit random, but it does seem to find the babble-like sequences quite efficiently (in a window of n words) so it's good enough for a quick comparison of the amount of such sequences. I suppose your generated text should behave like a word-shuffled version of the section(s) it has been trained on, i.e. less babble-like.

For the comparison to be more significant I guess some LAAFU statistics and inter-word statistics would be helpful, they might add a little bias in local similarity. They probably don't matter for the average edit distance between all words of different lines but might impact a little the babble detector on very short sequences of words. For this I used character trigrams statistics with special characters for line start and line end in my simple Markov chain generator (without word model, so the word length distribution was very wrong).
[+] 1 user says Thank You to nablator for this post
Reply


Messages In This Thread
RE: Templatic Voynich generator - by bi3mw - 04-06-2026, 10:45 PM
RE: Templatic Voynich generator - by oshfdk - 05-06-2026, 12:47 PM
RE: Templatic Voynich generator - by Koen G - 05-06-2026, 10:11 AM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 11:49 AM
RE: Templatic Voynich generator - by Mauro - 05-06-2026, 12:30 PM
RE: Templatic Voynich generator - by Mauro - 06-06-2026, 06:07 PM
RE: Templatic Voynich generator - by dashstofsk - 05-06-2026, 02:44 PM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 04:37 PM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 05:04 PM
RE: Templatic Voynich generator - by Dunsel - 06-06-2026, 04:16 AM
RE: Templatic Voynich generator - by nablator - 06-06-2026, 06:35 PM
RE: Templatic Voynich generator - by oshfdk - 08-06-2026, 02:44 PM
RE: Templatic Voynich generator - by Mauro - 08-06-2026, 05:43 PM
RE: Templatic Voynich generator - by Mauro - 09-06-2026, 07:45 AM
RE: Templatic Voynich generator - by petronio - 10-06-2026, 06:07 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Output from a Voynich generator I'm working on. Dunsel 18 4,312 16-05-2026, 08:44 PM
Last Post: Dunsel
  Voynich text generator Torsten 47 56,494 28-04-2020, 10:34 PM
Last Post: Ger Hungerink

Forum Jump:


Users browsing this thread: 2 Guest(s)