The following warnings occurred:
Warning [2] Undefined variable $can_link - Line: 6 - File: showthread.php(1658) : eval()'d code PHP 8.5.12 (Linux)
File Line Function
/inc/class_error.php 157 errorHandler->error
/showthread.php(1658) : eval()'d code 6 errorHandler->error_callback
/showthread.php 1658 eval




Automated Topic Analysis of the Voynich Manuscript
#60
(21-09-2025, 09:28 PM)quimqu wrote: You are not allowed to view links. Register or Login to view.Then I turn each paragraph into a bag-of-words

Ah, ok - so your unit is the parag, not the page.

(21-09-2025, 09:28 PM)quimqu wrote: You are not allowed to view links. Register or Login to view.The model learns two things: a set of word distributions (the topics themselves) and, for each paragraph, a vector of proportions telling how those topics are mixed. You choose K, the number of topics; too small and themes are merged, too large and they fragment.

So you are trying several K-clustering algorithms on the same set of data points, where each point is a bag-of-words -- essentially an N-vector where N is the number of distinct word types.  Where the algorithms do not assign each parag to a single cluster (topic), but gives it a "belonging" or "mixing" score for each cluster.  Is that correct?

Can we interpret those scores as Bayesian probabilities of the parag belonging to each topic?

All the best, --jorge
Reply


Messages In This Thread
RE: Automated Topic Analysis of the Voynich Manuscript - by Jorge_Stolfi - 21-09-2025, 09:45 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  How Different is Each Topic Each Other - Term Frequency Across Topic A.Wilmarth 6 7,197 31-07-2024, 04:28 PM
Last Post: RobGea
  Hypervector Analysis of the Voynich Manuscript dvallis 126 112,563 15-09-2020, 08:53 AM
Last Post: -JKP-

Forum Jump:


Users browsing this thread: 2 Guest(s)