[split] (lack of) word groups
#31
(03-07-2019, 03:16 PM)Koen G wrote: You are not allowed to view links. Register or Login to view.
I collected some numbers already, you can see them here (final sheet xMATTR):
You are not allowed to view links. Register or Login to view.

Of the texts I checked so far, here's the percentage that have no repeating strings of the following lengths:

2: 1% 
3: 6% 
4: 20% 
5: 32% 
6: 48% 

So about half of these texts never repeat a string of 6 words exactly (taking into account the 1000-word window I always used, which seems reasonably large). 
What may be more interesting is that 9 of my txt files never even repeat a 4-word string. 


Additionally, one file (attached) does apparently not even repeat 3-word strings. It's only 1762 words, which might explain a bit.

Still, I would seriously question the claim that natural languages cannot be without repeating "phrases". If the phrase is 4 words long, I have 9 counterexamples. Make the phrase 5 words long and 20% of checked texts don't repeat any.


Attached Files
.txt   092.AltaSilva.txt (Size: 11.68 KB / Downloads: 19)
[+] 1 user says Thank You to Koen G for this post
Reply
#32
Register or login to view the content
Reply
#33
Register or login to view the content
Reply
#34
Register or login to view the content
Reply
#35
Register or login to view the content
Reply
#36
Register or login to view the content
Reply
#37
Register or login to view the content
Reply
#38
Register or login to view the content


Attached Files
.txt   438.WolframLieder.txt (Size: 9.03 KB / Downloads: 39)
Reply
#39
Register or login to view the content
Reply
#40
Register or login to view the content
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  [split] (lack of) scribal mistakes / corrections -JKP- 88 74,923 29-03-2026, 10:14 PM
Last Post: Torsten
  [split] Word length autocorrelation ReneZ 22 11,129 06-09-2025, 11:13 AM
Last Post: Jorge_Stolfi
  [split] Percentage of word types that occur more than once bi3mw 37 35,153 25-06-2020, 05:41 PM
Last Post: Torsten
  [split] Line padding, layout, Currier's "groups of letters"... Torsten 37 39,018 16-03-2020, 06:33 AM
Last Post: Wladimir D
  [split] recurring word sequences doranchak 7 11,874 06-04-2018, 12:16 PM
Last Post: MarcoP

Forum Jump:


Users browsing this thread: 2 Guest(s)