26-04-2026, 05:32 AM
@quimqu
So indeed your data is finding word breaks at the end and start, but not balanced? What would that suggest about a fabricator who designed this into his conlang? Word breaks make a text not seem like gibberish. His intention that it had to follow zipf's law and would that indicate 20th century? This is a low entropy text! Excellent Post quimqu
Quote:– Around <->, the effect weaker than at the end and beginning of lines but it is asymmetric: the token before the split is more “end-like” than the token after it is “start-like”.
So indeed your data is finding word breaks at the end and start, but not balanced? What would that suggest about a fabricator who designed this into his conlang? Word breaks make a text not seem like gibberish. His intention that it had to follow zipf's law and would that indicate 20th century? This is a low entropy text! Excellent Post quimqu