The oddities of the bigram "ed"
#31
Two points:

- my question about "eed" was related to the suggestion that "ed" might be a single unit. While this is tempting, this then leaves the question whether "eed" is another unit, or should be read as "e" + "ed". Neither seem satisfactory to me. (words ending -edy can also end -ey, or -eedy, or -eey)

- in the graph where the text has been chopped into equal size units, and the "ed" bigram moves much closer to the rest, were the page boundaries respected? I strongly suspect not, so the pages without "ed" have been 'contaminated' by contents from pages with the bigram.

On the second point, a related statistic is given on this page: You are not allowed to view links. Register or Login to view.
in the table under "At the highest level". This gives the % of words including "ed" in the various sections, which is largely independent of the page length, which was the desired point.
[+] 2 users say Thank You to ReneZ for this post
Reply
#32
Register or login to view the content
[+] 2 users say Thank You to Jorge_Stolfi for this post
Reply
#33
Register or login to view the content
[+] 1 user says Thank You to nablator for this post
Reply
#34
Register or login to view the content
[+] 6 users say Thank You to ReneZ for this post
Reply
#35
Register or login to view the content
Reply
#36
Register or login to view the content
[+] 1 user says Thank You to nablator for this post
Reply
#37
Register or login to view the content
[+] 1 user says Thank You to Dunsel for this post
Reply
#38
Register or login to view the content
[+] 1 user says Thank You to Dunsel for this post
Reply
#39
Register or login to view the content
Reply
#40
Register or login to view the content
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  The oddities of the bigram "ed" pt. 4 : The Chunking of Scribes Dunsel 13 3,524 29-05-2026, 06:27 PM
Last Post: Dunsel
  The oddities of the bigram "ed" pt. 3 : It's not just "ed" Dunsel 18 5,889 20-02-2026, 08:43 PM
Last Post: Jorge_Stolfi
  The oddities of the bigram "ed" pt. 2: Same as it ever was. Dunsel 16 5,887 18-02-2026, 06:45 PM
Last Post: Jorge_Stolfi

Forum Jump:


Users browsing this thread: 2 Guest(s)