Brian just reported on IRC: Tests: 5307, Assertions: 497129, Failures: 11, Errors: 332, Incomplete: 3, Skipped: 17. I had to edit files just to make them not give a php fatal error.

I suggested: Maybe you, Niklas and Antoine should discuss this and devise a plan? I do know that Niklas keeps being annoyed about the tests not running reliably and/or consistently in his development environment, and we can really address this issue, I think.

by changing the user to www-data instead of my normal user, I got the errors down to about 282.

The original issue was:

Fatal error: Cannot redeclare class ParserTests in /var/www/w/git/tests/phpunit/includes/parser/MediaWikiParserTest.php(27) : eval()'d code on line 3

Which prevents unit tests from running. I'm running PHP 5.3.3-7

After getting it working by renaming MediaWikiParserTest.php to something without a php extension, I get _a lot_ of errors:

FAILURES!
Tests: 5307, Assertions: 446595, Failures: 18, Errors: 282, Incomplete: 3, Skipped: 17.

282 errors seems absurdly high...

And the errors are? Please attach a full log of your PHPUnit output :-]

Also consider running the unit test with a default LocalSettings.php as created with the installer.

(In reply to comment #3)

Also consider running the unit test with a default LocalSettings.php as
created
with the installer.

Doesn't that defeat the point of tests - if they suddenly stop working due to configuration?

Then that means the tests need to be improved :-] They should at least work with the default settings.

(In reply to comment #2)

by changing the user to www-data instead of my normal user, I got the errors
down to about 282.

The original issue was:

Fatal error: Cannot redeclare class ParserTests in
/var/www/w/git/tests/phpunit/includes/parser/MediaWikiParserTest.php(27) :
eval()'d code on line 3

Which prevents unit tests from running. I'm running PHP 5.3.3-7

This was due to bug 42174. I've submitted gerrit change 67098

Does this still happen with the current release/HEAD?

Assuming it got fixed somehow.