diff options
author | Adam Hodgen <ant1441@gmail.com> | 2022-02-18 22:46:28 +0000 |
---|---|---|
committer | Andreas Kling <kling@serenityos.org> | 2022-02-21 16:31:45 +0100 |
commit | d73bb2633ca2343905c5cf03b10944f7f8ffc891 (patch) | |
tree | 715de5d212f3a3574158008afe8bfed52845436e /Tests/LibWeb/TestHTMLTokenizer.cpp | |
parent | c6fcdd0f93cd8c49a6024a65d808b69b701e7ecc (diff) | |
download | serenity-d73bb2633ca2343905c5cf03b10944f7f8ffc891.zip |
LibWeb: Implement tokenization newline preprocessing
Newline normalization will replace \r and \r\n with \n.
The spec specifically states
> Before the tokenization stage, the input stream must be preprocessed
> by normalizing newlines.
wheras this is implemented the processing during the tokenization
itself.
This should still exhibit the same behaviour, while keeping the
tokenization logic in the same place.
Diffstat (limited to 'Tests/LibWeb/TestHTMLTokenizer.cpp')
0 files changed, 0 insertions, 0 deletions