Cal asked on Twitter:
What is the metric for success for testFest?
I thought it would be a good idea to take this to the mailing list to
generate some discussion about it, and since my answer is longer than
I have three main goals for this incarnation of PHP TestFest, none of
which are to increase the code coverage metrics of the PHP language (see
coverage reports here: <http://gcov.php.net/>):
1) Increase awareness of how PHP is tested
2) Show that there are more ways to contribute to the PHP core than
through hacking on the engine in C
3) Introduce newer folks in the community to phpt tests and teach them
how to write and run them
For the group of folks in #3, I hope that they'll become frequent core
contributors, once they know the environment and how to write and run
#1 and #2 are difficult to measure, but with #3, it may be possible to
measure the number of people who have never contributed to php-src who
have submitted new phpt tests during PHP TestFest.
For all 3 items, I'd like to record the number of groups who
participated and held at least one PHP TestFest event, the number of
total PHP TestFest events, and the number of people who attended each
event. It would also be good information to know the number of phpt
tests contributed by each group (i.e., the aggregate of tests
submitted by members of each group).
So, that's a quick brain dump.