Paragraph Boundaries Are Not White Space:Compression Depth as the Signature of Hierarchical Structure

Excerpt

arXiv:2609.23551v1 Announce Type: new Abstract: Standard positional encodings represent position as a one-dimensional reading-order coordinate, but reading order alone does not determine hierarchical textual structure. We use a hierarchical rotary positional encoding (hRoPE) that represents paragraph, sentence, and token indices as separate channels, hold the token sequence fixed, intervene on the paragraph coordinate p1, and measure cross-paragraph attention with a token-distance-exact estimato