VM TTR values
#1
Since the main discussion is going on in the off-topic section, I thought it might be worthwhile to make a separate thread for discussion of the VM values.
Once again I'd like to thank everyone who helped me out, many interventions were required for me to get to this point. I would be so hopeless without you guys.
I redid everything using Rene's ZL2a file (more spaces) as recommended by Nablator. From this I isolated five sections:

  1. Herbal A 
  2. Herbal B
  3. Q13
  4. Small plants (with labels removed, so only the paragraphs)
  5. Q20
I then used Nablator's code to calculate the following MATTR window sizes: 2, 3, 4, 5, 10, 20, 50, 100, 500.
Using my corpus of 471 texts, I calculated mean and stdev for each window. This allowed me to normalize the values.
The result is as follows:

   

As you can see, both B-sections (orange and red) behave similarly. 
Herbal A and the paragraphs from the small plants behave very similarly as well. Is the latter entirely A?

And Q13 has overall much lower values. The way I read the graph, this appears to be the result of larger distance repetitions. Below 5, it starts to approach the other sections again.
[+] 2 users say Thank You to Koen G for this post
Reply
#2
Register or login to view the content
Reply
#3
Register or login to view the content
[+] 1 user says Thank You to Koen G for this post
Reply
#4
Register or login to view the content
[+] 1 user says Thank You to MarcoP for this post
Reply
#5
Register or login to view the content
Reply
#6
Register or login to view the content
[+] 2 users say Thank You to ReneZ for this post
Reply
#7
Register or login to view the content
Reply
#8
Register or login to view the content
Reply
#9
Register or login to view the content
[+] 1 user says Thank You to Koen G for this post
Reply
#10
Register or login to view the content
[+] 1 user says Thank You to ReneZ for this post
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  TF-IDF values of categories Addsamuels 9 6,421 04-03-2025, 01:19 AM
Last Post: Addsamuels

Forum Jump:


Users browsing this thread: 2 Guest(s)