(24-04-2025, 10:20 AM)oshfdk wrote: You are not allowed to view links. Register or Login to view.

(24-04-2025, 09:43 AM)Urtx13 wrote: You are not allowed to view links. Register or Login to view.What the project does (in plain terms)

Sorry, but probably this is not plain enough for me, I'm still stumped  . Could you try explaining it is simpler terms, or maybe better let's try some Q&A?

1) You mention cycles, but I don't understand how these cycles relate to the text. Is it topics cycling through folios? Do we have to assume the present ordering of folios for these cycles to make sense? Are there cycles within folios?

2) Basically, as far as I can see, the model splits the text into 4 topics (the number of topics is imposed upon the model) and then it is tested that the model can correctly identify the topic based on the tokens. I'm not sure what this proves exactly, I would assume if you take any text separated into chunks and ask a model to produce a split of chunks into 4 topics, the model will successfully identify some split based on token frequencies and then will successfully sort new chunks according to this split. I think I'm missing something here.