Structure of Award System & Prize Sponsorship Expectation

TL;DR: There’s a lot here, but I need your help and input, so please take time to read and respond.

I’m forwarding Khayrattee’s message below from the sponsors mailing list, since I’d like everyone else on this list to be able to participate in this discussion.

First, a few updates:
I am behind on things I wanted to have ready by September 1.
I’m working on a way to share and contribute slides for PHP TestFest presentations so that group leaders are able to present without much preparation. That is a work-in-progress in this branch here: <https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides>.
In our last Google Hangouts session, Sara proposed the idea of a points system for awarding prizes. What follows is a rough outline of how I think that should work. **I would like feedback.**
We need a tutorial/presentation clearly outlining the steps to create and submit tests for consideration in PHP TestFest. The following notes also talk a little bit about this process.

SUBMISSION PROCESS AND POINTS SYSTEM (needs feedback)
We will need reviewers who have the expertise needed to review phpt tests and judge whether they are good and useful tests.
Sara Golemon and Joe Watkins have volunteered as reviewers. We need a few more.
General test submissions for PHP TestFest must be made as PRs to the phptestfest-2017-master branch at this repo: <https://github.com/phpcommunity/phptestfest-php-src>
Bug test submissions (for bugs logged at <https://bugs.php.net/>) must be made against the appropriate PHP version branch at the same repo (phptestfest-2017-PHP-7.2, phptestfest-2017-PHP-7.1, or phptestfest-2017-PHP-7.0).
Each pull request should include only one test file. This makes reviewing and awarding points simpler.
Reviewers will have access to review these PRs and will award points to submissions.
Points could be awarded, as follows:
1 point for each valid submission
Extra points for a test that verifies a bug from <https://bugs.php.net/>
Extra points for a particularly meaningful test
5 points for a submitter who has never contributed to core
10 points for finding a bug and opening a new bug report
Extra points for improving an existing test to make it run faster or not fail intermittently
Each point counts as an entry in the raffle, so the more points you have, the higher your chances of winning a prize
In addition to the raffle, the reviewers will pick three submitters whose work stands out from the rest. These three will receive “big” prizes (what do we want to consider “big?”).
The group whose members receive the most total points will win a prize. What kind of prize would be good for a group?
Could we give away something like a sticker pack to all who participated?
As for tracking the points, submissions, and groups, I am working on a site that integrates with GitHub and can help us keep track of these things.

Okay, that’s enough brain dump for now. I want to hear from you. Khayrattee’s message follows. He needs feedback, as well.

Cheers,
Ben

···

Begin forwarded message:

From: Khayrattee Wasseem
Subject: [ThinkTank Session] - Structure of Award System & Prize Sponsorship Expectation..etc
Date: August 30, 2017 at 10:15:13 AM CDT
To: PHP TestFest Sponsorships

Hi Ben,

following my first batch of email request to potential sponsors (I reached out to 23 companies & other individuals), it came to mind about the below:

1) What are we expecting from Sponsors?

i) Are we expecting them to "propose what they can offer"
ii) or do we actually want them to "buy in & provide" what we actually want them to provide.

To a couple of them, I have said that we currently do not have any kind of package, we are still working on an approach. And they could just propose what they can offer, for e.g any kind of subscriptions, vouchers, tools, tool licenses or ebooks - that could actually be useful to any (dev) participant and hence serve nicely as "prize raffles".

2) How will the sponsor get their name out there to the crowd? The places of exposure where sponsors will be listed..etc

3) A rough number of participants - so sponsors can better propose how much to actually provide..etc

4) Featuring Sponsors on our TestFest website - details we need from them:
i) Logo or banner (what acceptable sizes?)
ii) A bio or just the title of their company?
iii) Will we allow them to put a small marketing message as well?
iv) And I guess we should also let them display contact points - Main contact person, email or social pointers..etc ?

Would be great if we can all agree on finalising 'way-forward' to the above and I can better address/communicate with potential sponsors to convince them.

Anything I missed or you have (had) in mind?

PS: Let me know anything else in terms of expectation from me, so I can help further.

Let's Rock This PHP TestFest!
cheers
7PHP

First of all, thanks to Ben, Khayrattee, and all the others working hard to organize this and make it easier for groups to participate.

Having prizes is a fun way to get people excited to participate, and I agree that having a well-defined way to award those prizes is also important. What you've outlined below is really good so far, but I do have some additional comments and questions:

* What constitutes a "valid submission"?
* If 10 people submit an identical test, do all 10 get the points? If not, does it go to the first submitter? Or the first person per time zone? Something else?
* Will there be any kind of task board to prevent overlap of work? For example, do we want people to say "Hey I'm working on writing a repro test for Bug #75000" so others can be aware and efforts can be de-duplicated?
* If someone finds a bug and opens a new report, but it turns out to be a duplicate bug report, would they still get 10 points? What if it's closed as "Wont fix" or "not a bug"?
* How will we confirm an improved test is actually faster or doesn't fail intermittently? Is there some sort of performance improvement threshold to qualify?

As for identifying "big" prizes, I'd do it two different ways: If something is unique/one of a kind (elephant signed by php core members, etc) it should be considered a big prize. The other way might be based on monetary value, though I'm not sure what the exact value would be without seeing a list of available prizes. Maybe the top X most valuable prizes depending on how many "big" prizes we want to award?

As for what would be a good group prize, I'd say any prize could qualify. The group could turn around and raffle it off to those that participated. There might also be some prizes that would be specifically for a group: free year of Meetup fees, or something like what NomadPHP did with a care package for user groups with a video presentation, swag, and prizes. Maybe we could even get a couple PHP core people to volunteer a "remote user group presentation" as a group prize?

Joel Clermont
414-852-6221

···

On Aug 30, 2017, at 10:55 AM, Ben Ramsey <ben@benramsey.com> wrote:

TL;DR: There’s a lot here, but I need your help and input, so please take time to read and respond.

I’m forwarding Khayrattee’s message below from the sponsors mailing list, since I’d like everyone else on this list to be able to participate in this discussion.

First, a few updates:
I am behind on things I wanted to have ready by September 1.
I’m working on a way to share and contribute slides for PHP TestFest presentations so that group leaders are able to present without much preparation. That is a work-in-progress in this branch here: <https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides>.
In our last Google Hangouts session, Sara proposed the idea of a points system for awarding prizes. What follows is a rough outline of how I think that should work. **I would like feedback.**
We need a tutorial/presentation clearly outlining the steps to create and submit tests for consideration in PHP TestFest. The following notes also talk a little bit about this process.

SUBMISSION PROCESS AND POINTS SYSTEM (needs feedback)
We will need reviewers who have the expertise needed to review phpt tests and judge whether they are good and useful tests.
Sara Golemon and Joe Watkins have volunteered as reviewers. We need a few more.
General test submissions for PHP TestFest must be made as PRs to the phptestfest-2017-master branch at this repo: <https://github.com/phpcommunity/phptestfest-php-src>
Bug test submissions (for bugs logged at <https://bugs.php.net/>) must be made against the appropriate PHP version branch at the same repo (phptestfest-2017-PHP-7.2, phptestfest-2017-PHP-7.1, or phptestfest-2017-PHP-7.0).
Each pull request should include only one test file. This makes reviewing and awarding points simpler.
Reviewers will have access to review these PRs and will award points to submissions.
Points could be awarded, as follows:
1 point for each valid submission
Extra points for a test that verifies a bug from <https://bugs.php.net/>
Extra points for a particularly meaningful test
5 points for a submitter who has never contributed to core
10 points for finding a bug and opening a new bug report
Extra points for improving an existing test to make it run faster or not fail intermittently
Each point counts as an entry in the raffle, so the more points you have, the higher your chances of winning a prize
In addition to the raffle, the reviewers will pick three submitters whose work stands out from the rest. These three will receive “big” prizes (what do we want to consider “big?”).
The group whose members receive the most total points will win a prize. What kind of prize would be good for a group?
Could we give away something like a sticker pack to all who participated?
As for tracking the points, submissions, and groups, I am working on a site that integrates with GitHub and can help us keep track of these things.

Okay, that’s enough brain dump for now. I want to hear from you. Khayrattee’s message follows. He needs feedback, as well.

Cheers,
Ben

Begin forwarded message:

From: Khayrattee Wasseem
Subject: [ThinkTank Session] - Structure of Award System & Prize Sponsorship Expectation..etc
Date: August 30, 2017 at 10:15:13 AM CDT
To: PHP TestFest Sponsorships

Hi Ben,

following my first batch of email request to potential sponsors (I reached out to 23 companies & other individuals), it came to mind about the below:

1) What are we expecting from Sponsors?

i) Are we expecting them to "propose what they can offer"
ii) or do we actually want them to "buy in & provide" what we actually want them to provide.

To a couple of them, I have said that we currently do not have any kind of package, we are still working on an approach. And they could just propose what they can offer, for e.g any kind of subscriptions, vouchers, tools, tool licenses or ebooks - that could actually be useful to any (dev) participant and hence serve nicely as "prize raffles".

2) How will the sponsor get their name out there to the crowd? The places of exposure where sponsors will be listed..etc

3) A rough number of participants - so sponsors can better propose how much to actually provide..etc

4) Featuring Sponsors on our TestFest website - details we need from them:
i) Logo or banner (what acceptable sizes?)
ii) A bio or just the title of their company?
iii) Will we allow them to put a small marketing message as well?
iv) And I guess we should also let them display contact points - Main contact person, email or social pointers..etc ?

Would be great if we can all agree on finalising 'way-forward' to the above and I can better address/communicate with potential sponsors to convince them.

Anything I missed or you have (had) in mind?

PS: Let me know anything else in terms of expectation from me, so I can help further.

Let's Rock This PHP TestFest!
cheers
7PHP

--
You received this message because you are subscribed to the Google Groups "PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testfest+unsubscribe@phpcommunity.org <mailto:testfest+unsubscribe@phpcommunity.org>.
To post to this group, send email to testfest@phpcommunity.org <mailto:testfest@phpcommunity.org>.
Visit this group at https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/5A49F975-6C3F-4E07-AF4F-2B62827E9EF1%40benramsey.com?utm_medium=email&utm_source=footer>.

Ben, others,

If none of you have done so already, I'd love to create a few slides that UG's can use to inform their peers about what to do, how to do it and who to inform.

I love to be a reviewer, even though I'm not super fluent in C. I guess my previous experiences with PHPTestFest '09 & '12 gave me enough understanding what is required during TestFestPHP.

In regards to sponsorships mentioned by Khayrattee I think local sponsorships would work out better for shirts, mugs, general swag and so on. Given the idea of a leaderboard and such, maybe finding sponsors for 1st, 2nd and 3rd spot prizes would be really awesome.

Michelangelo

···

On 30 Aug 2017, at 17:55, Ben Ramsey <ben@benramsey.com> wrote:

TL;DR: There’s a lot here, but I need your help and input, so please take time to read and respond.

I’m forwarding Khayrattee’s message below from the sponsors mailing list, since I’d like everyone else on this list to be able to participate in this discussion.

First, a few updates:
I am behind on things I wanted to have ready by September 1.
I’m working on a way to share and contribute slides for PHP TestFest presentations so that group leaders are able to present without much preparation. That is a work-in-progress in this branch here: <https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides>.
In our last Google Hangouts session, Sara proposed the idea of a points system for awarding prizes. What follows is a rough outline of how I think that should work. **I would like feedback.**
We need a tutorial/presentation clearly outlining the steps to create and submit tests for consideration in PHP TestFest. The following notes also talk a little bit about this process.

SUBMISSION PROCESS AND POINTS SYSTEM (needs feedback)
We will need reviewers who have the expertise needed to review phpt tests and judge whether they are good and useful tests.
Sara Golemon and Joe Watkins have volunteered as reviewers. We need a few more.
General test submissions for PHP TestFest must be made as PRs to the phptestfest-2017-master branch at this repo: <https://github.com/phpcommunity/phptestfest-php-src>
Bug test submissions (for bugs logged at <https://bugs.php.net/>) must be made against the appropriate PHP version branch at the same repo (phptestfest-2017-PHP-7.2, phptestfest-2017-PHP-7.1, or phptestfest-2017-PHP-7.0).
Each pull request should include only one test file. This makes reviewing and awarding points simpler.
Reviewers will have access to review these PRs and will award points to submissions.
Points could be awarded, as follows:
1 point for each valid submission
Extra points for a test that verifies a bug from <https://bugs.php.net/>
Extra points for a particularly meaningful test
5 points for a submitter who has never contributed to core
10 points for finding a bug and opening a new bug report
Extra points for improving an existing test to make it run faster or not fail intermittently
Each point counts as an entry in the raffle, so the more points you have, the higher your chances of winning a prize
In addition to the raffle, the reviewers will pick three submitters whose work stands out from the rest. These three will receive “big” prizes (what do we want to consider “big?”).
The group whose members receive the most total points will win a prize. What kind of prize would be good for a group?
Could we give away something like a sticker pack to all who participated?
As for tracking the points, submissions, and groups, I am working on a site that integrates with GitHub and can help us keep track of these things.

Okay, that’s enough brain dump for now. I want to hear from you. Khayrattee’s message follows. He needs feedback, as well.

Cheers,
Ben

Begin forwarded message:

From: Khayrattee Wasseem
Subject: [ThinkTank Session] - Structure of Award System & Prize Sponsorship Expectation..etc
Date: August 30, 2017 at 10:15:13 AM CDT
To: PHP TestFest Sponsorships

Hi Ben,

following my first batch of email request to potential sponsors (I reached out to 23 companies & other individuals), it came to mind about the below:

1) What are we expecting from Sponsors?

i) Are we expecting them to "propose what they can offer"
ii) or do we actually want them to "buy in & provide" what we actually want them to provide.

To a couple of them, I have said that we currently do not have any kind of package, we are still working on an approach. And they could just propose what they can offer, for e.g any kind of subscriptions, vouchers, tools, tool licenses or ebooks - that could actually be useful to any (dev) participant and hence serve nicely as "prize raffles".

2) How will the sponsor get their name out there to the crowd? The places of exposure where sponsors will be listed..etc

3) A rough number of participants - so sponsors can better propose how much to actually provide..etc

4) Featuring Sponsors on our TestFest website - details we need from them:
i) Logo or banner (what acceptable sizes?)
ii) A bio or just the title of their company?
iii) Will we allow them to put a small marketing message as well?
iv) And I guess we should also let them display contact points - Main contact person, email or social pointers..etc ?

Would be great if we can all agree on finalising 'way-forward' to the above and I can better address/communicate with potential sponsors to convince them.

Anything I missed or you have (had) in mind?

PS: Let me know anything else in terms of expectation from me, so I can help further.

Let's Rock This PHP TestFest!
cheers
7PHP

--
You received this message because you are subscribed to the Google Groups "PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testfest+unsubscribe@phpcommunity.org <mailto:testfest+unsubscribe@phpcommunity.org>.
To post to this group, send email to testfest@phpcommunity.org <mailto:testfest@phpcommunity.org>.
Visit this group at https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/5A49F975-6C3F-4E07-AF4F-2B62827E9EF1%40benramsey.com?utm_medium=email&utm_source=footer>.

If none of you have done so already, I'd love to create a few slides that UG's can use to inform their peers about what to do, how to do it and who to inform.

I would love help creating slides. I’ve pointed Mark Railton to this branch in the repo, since he just gave a presentation at the Dublin group last night, but I’d love some collaboration here:

https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides

It’s very simple to get set up with Hovercraft (the presentation generator), but if you have questions, let me know. We can start a new thread or discuss on IRC, etc.

I love to be a reviewer, even though I'm not super fluent in C. I guess my previous experiences with PHPTestFest '09 & '12 gave me enough understanding what is required during TestFestPHP.

This would be great! I’ll start another thread to discuss reviewing and what that entails.

In regards to sponsorships mentioned by Khayrattee I think local sponsorships would work out better for shirts, mugs, general swag and so on. Given the idea of a leaderboard and such, maybe finding sponsors for 1st, 2nd and 3rd spot prizes would be really awesome.

We can definitely have a points leaderboard generated by this site I’m building. Once I have more of the foundation in place, I’ll push up the app and open it for contributions.

-Ben

···

On Aug 30, 2017, at 11:49 AM, Michelangelo van Dam <dragonbe@gmail.com> wrote:

How does one note which UG they belong to so that groups can generate
points?

···

On Wed, Aug 30, 2017 at 11:54 AM Ben Ramsey <ben@benramsey.com> wrote:

> On Aug 30, 2017, at 11:49 AM, Michelangelo van Dam <dragonbe@gmail.com> > wrote:
>
> If none of you have done so already, I'd love to create a few slides
that UG's can use to inform their peers about what to do, how to do it and
who to inform.

I would love help creating slides. I’ve pointed Mark Railton to this
branch in the repo, since he just gave a presentation at the Dublin group
last night, but I’d love some collaboration here:

https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides

It’s very simple to get set up with Hovercraft (the presentation
generator), but if you have questions, let me know. We can start a new
thread or discuss on IRC, etc.

> I love to be a reviewer, even though I'm not super fluent in C. I guess
my previous experiences with PHPTestFest '09 & '12 gave me enough
understanding what is required during TestFestPHP.

This would be great! I’ll start another thread to discuss reviewing and
what that entails.

> In regards to sponsorships mentioned by Khayrattee I think local
sponsorships would work out better for shirts, mugs, general swag and so
on. Given the idea of a leaderboard and such, maybe finding sponsors for
1st, 2nd and 3rd spot prizes would be really awesome.
>

We can definitely have a points leaderboard generated by this site I’m
building. Once I have more of the foundation in place, I’ll push up the app
and open it for contributions.

-Ben

--
You received this message because you are subscribed to the Google Groups
"PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to testfest+unsubscribe@phpcommunity.org.
To post to this group, send email to testfest@phpcommunity.org.
Visit this group at
https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit
https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/2D9B38D8-26C1-4529-804A-770EEA433884%40benramsey.com
.

As for determining "big" prizes.

Since you can determine 3 standouts, do you think you could determine a
1st, 2nd, 3rd place by vote of some committee?

If so, what about just having a list of all of the prizes, and those 3
winners are given a choice of prizes? Then we are determining value, or
choosing what someone would want. The signed elephpant for example may
mean more to one person than another.

···

--
John Congdon
CEO
DiegoDev Group, LLC

Privacy and Confidentiality Notice:
The information contained in this electronic mail message is CONFIDENTIAL
and is intended for the named recipient(s) only. It may contain privileged
and confidential information. If you are not an intended recipient, you
must not copy, forward, distribute or take action in reliance on it. If you
have received this electronic mail message in error, please notify the
sender immediately.

On Wed, Aug 30, 2017 at 12:37 PM Eric Poe <eric.poe@gmail.com> wrote:

How does one note which UG they belong to so that groups can generate
points?

--
John Congdon
CEO
DiegoDev Group, LLC

Privacy and Confidentiality Notice:
The information contained in this electronic mail message is CONFIDENTIAL
and is intended for the named recipient(s) only. It may contain privileged
and confidential information. If you are not an intended recipient, you
must not copy, forward, distribute or take action in reliance on it. If you
have received this electronic mail message in error, please notify the
sender immediately.

On Wed, Aug 30, 2017 at 11:54 AM Ben Ramsey <ben@benramsey.com> wrote:

> On Aug 30, 2017, at 11:49 AM, Michelangelo van Dam <dragonbe@gmail.com> >> wrote:
>
> If none of you have done so already, I'd love to create a few slides
that UG's can use to inform their peers about what to do, how to do it and
who to inform.

I would love help creating slides. I’ve pointed Mark Railton to this
branch in the repo, since he just gave a presentation at the Dublin group
last night, but I’d love some collaboration here:

https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides

It’s very simple to get set up with Hovercraft (the presentation
generator), but if you have questions, let me know. We can start a new
thread or discuss on IRC, etc.

> I love to be a reviewer, even though I'm not super fluent in C. I guess
my previous experiences with PHPTestFest '09 & '12 gave me enough
understanding what is required during TestFestPHP.

This would be great! I’ll start another thread to discuss reviewing and
what that entails.

> In regards to sponsorships mentioned by Khayrattee I think local
sponsorships would work out better for shirts, mugs, general swag and so
on. Given the idea of a leaderboard and such, maybe finding sponsors for
1st, 2nd and 3rd spot prizes would be really awesome.
>

We can definitely have a points leaderboard generated by this site I’m
building. Once I have more of the foundation in place, I’ll push up the app
and open it for contributions.

-Ben

--
You received this message because you are subscribed to the Google Groups
"PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to testfest+unsubscribe@phpcommunity.org.
To post to this group, send email to testfest@phpcommunity.org.
Visit this group at
https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit
https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/2D9B38D8-26C1-4529-804A-770EEA433884%40benramsey.com
.

--
You received this message because you are subscribed to the Google Groups
"PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to testfest+unsubscribe@phpcommunity.org.
To post to this group, send email to testfest@phpcommunity.org.
Visit this group at
https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit
https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/CAC2L_85Z95JTRR3_W_Co2cq9b2yf_gxOhf1dNZoKbJd4a9Dp1Q%40mail.gmail.com
<https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/CAC2L_85Z95JTRR3_W_Co2cq9b2yf_gxOhf1dNZoKbJd4a9Dp1Q%40mail.gmail.com?utm_medium=email&utm_source=footer>
.

The tool I’m writing to help us track contributions and points will allow us to create groups and will let users specify which group they belong to.

-Ben

···

On Aug 30, 2017, at 2:37 PM, Eric Poe <eric.poe@gmail.com> wrote:

How does one note which UG they belong to so that groups can generate points?