2e7642a658
Refactor tokenizer from 320-line linear scan to full WHATWG §13.2.5 state machine with all 80 states. Add RCDATA, RAWTEXT, PLAINTEXT, ScriptData (with escape/double-escape), character reference states, CDATA sections, and bogus comments. Replace ~100-entity table with full HTML5 set (2,125 unique entries) using sorted array + binary search. Add ParseError tracking with 33 error kinds including line/column info. Code review fixes: remove dead Token::RawText variant and tree_builder branches, add duplicate attribute detection, add noncharacter/control char reference checks per §13.2.5.80, fix noscript unconditional RAWTEXT handling, rename golden 093 to 275 to avoid number collision, add script escape/double-escape tests. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
11 lines
191 B
HTML
11 lines
191 B
HTML
<!DOCTYPE html>
|
|
<html>
|
|
<head>
|
|
<title>Title with & entity</title>
|
|
<style>body { margin: 8px; }</style>
|
|
</head>
|
|
<body>
|
|
<xmp>This is <b>preformatted</b> & raw text</xmp>
|
|
</body>
|
|
</html>
|