[fpc-devel] [patch] pscanner: differentiate between EOL & Tab characters from general Whitespace

[Michael Van Canneyt]

On Sun, 22 Aug 2010, Graeme Geldenhuys wrote:

> Hi,
>
> In the following bug report, I attached a minor patch for the pascal
> scanner in fcl-passrc.
> http://bugs.freepascal.org/view.php?id=17237
>
> I introduced two new tokens. Without this it is not possible to
> rebuild a source code unit from
> a token list.

I cannot accept this patch as it is.

It breaks the parser, more specifically NextToken.
The parser ignores whitespace. It should also ignore the new tokens.

Other than that, I doubt the usefulness of this patch. 
You are on the wrong track with what you attempt to do.

Michael