The following warnings occurred:
Warning [2] Undefined variable $can_link - Line: 6 - File: showthread.php(1658) : eval()'d code PHP 8.5.12 (Linux)
File Line Function
/inc/class_error.php 157 errorHandler->error
/showthread.php(1658) : eval()'d code 6 errorHandler->error_callback
/showthread.php 1658 eval




Vocabulary size by Illustration Type
#12
(05-07-2022, 08:26 PM)Bernd wrote: You are not allowed to view links. Register or Login to view.Large differences in sample text size are certainly a problem but it can be addressed by subsampling.

You can split each section into chunks of ~1000 vords each (maybe rounded to full pages) to match text length to the smallest and 2nd smallest ones (Astro and Zodiac).

Yes, this is a valid approach statistically, but of course it weakens the statistics of the larger sections.
It also removes the meaning of the idea of a 'corpus'.
Reply


Messages In This Thread
Vocabulary size by Illustration Type - by RobGea - 03-07-2022, 03:30 PM
RE: Vocabulary size by Illustration Type - by ReneZ - 05-07-2022, 09:04 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  The rate of vocabulary growth as the content type marker Anton 5 8,597 20-09-2019, 11:02 AM
Last Post: -JKP-

Forum Jump:


Users browsing this thread: 1 Guest(s)