18-04-2026, 07:13 PM
Jorge,
Good point, and I agree with your reasoning about SLA effects surviving space removal.
But just to clarify what I did, after removing spaces I’m not working with tokens anymore. I’m looking at character sequences directly, so in principle I’m removing the “word layer” and any token-based bias.
Even then, the model can still detect line starts and ends quite clearly from character patterns alone. That’s the part I find hard to explain purely as a side effect of line breaking on tokens.
Maybe SLA can still induce that indirectly through token composition, but then it would have to leave a pretty strong and structured footprint at the character level.
Good point, and I agree with your reasoning about SLA effects surviving space removal.
But just to clarify what I did, after removing spaces I’m not working with tokens anymore. I’m looking at character sequences directly, so in principle I’m removing the “word layer” and any token-based bias.
Even then, the model can still detect line starts and ends quite clearly from character patterns alone. That’s the part I find hard to explain purely as a side effect of line breaking on tokens.
Maybe SLA can still induce that indirectly through token composition, but then it would have to leave a pretty strong and structured footprint at the character level.