Nikita Popov 47cf18ba4e Don't include trailing newline in comment token ...

Don't include a trailing newline in T_COMMENT tokens, instead leave
it for a following T_WHITESPACE token. The newline does not belong
to the comment logically, and this makes for an ugly special case,
as other tokens do not include trailing newlines.

Whitespace-sensitive tooling will want to either forward or backward
emulate this change.

Closes GH-5182.

2020-06-25 11:25:22 +02:00

..

tests

Don't include trailing newline in comment token

2020-06-25 11:25:22 +02:00

config.m4

Normalize comments in *nix build system m4 files

2019-05-12 18:43:03 +02:00

config.w32

Sync leading and final newlines in source code files

2018-10-14 12:56:38 +02:00

CREDITS

- MFH: Use a script to generate tokenizer data from zend_language_parser.h

2007-07-31 23:24:11 +00:00

Makefile.frag

Fix #70831: Compile fails on system with 160 CPUs

2015-12-06 12:37:08 +01:00

php_tokenizer.h

Remove mention of PHP major version in Copyright headers

2019-09-25 14:51:43 +02:00

tokenizer_arginfo.h

Include stub hash in generated arginfo files

2020-06-24 09:55:19 +02:00

tokenizer_data_gen.sh

Add PhpToken class

2020-03-26 11:09:18 +01:00

tokenizer_data.c

Make throw statement an expression

2020-04-23 12:51:23 +02:00

tokenizer.c

Add helper APIs for maybe-interned string creation

2020-06-08 15:31:52 +02:00

tokenizer.stub.php

Generate function entries from stubs for a couple of extensions

2020-04-14 11:49:02 +02:00