Difference between revisions of "Using the Computerized Scoring System"

From TRCWiki
Jump to navigation Jump to search
m (copy-paste from Teresa's original; copy edit; add wiki formatting)
 
 
(16 intermediate revisions by 3 users not shown)
Line 1: Line 1:
== Setting Up the Computerized Scoring System ==
Rallyemasters can use [[User:Stefanis|Nick Stefanisko]]'s computerized scoring system to score rallyes, to quickly rescore rallyes based on granted protests, and to generate final results and statistics.
If given sufficient notice prior to the event, Nick and [[User:Tstefanisko|Teresa Stefanisko]] can provide a laptop computer for use with the scoring system.


If you want to use the computerized scoring system during your rallye to score and/or after the rallye to create
Before using the computerized scoring system, rallyemasters must visit [http://www.ipidooma.net/rallye/index.php www.ipidooma.net/rallye/] and create a new ''rallye scoring profile'' and then precheck it carefully.
the results the following needs to be done.


=== Before the rallye===
It is also possible to use the scoring system to generate results and statistics for a rallye that was [[Scoring a Rallye by Hand|scored by hand]].


# Go to http://www.ipidooma.net/rallye/index.php and create a new rallye.
The results document lists each team's score and standing, as well as the names of the driver, navigator, and any passengers (if they were entered).
# Follow the directions on the following screens to complete the scoring profile for your rallye.
# Once the scoring profile is created precheck it carefully. A recommended precheck is covered in [[#Scoring System Precheck|Scoring System Precheck]].
# If you plan on using the system to score during the rallye contact Nick or Teresa Stefanisko 1 week prior to the rallye so they can ensure the rallye laptop is charged and ready the night of the rallye. If you wish to instead use your own laptop to score the rallye contact Nick or Teresa for the requirements to run the system.
# Once the scoring system is finalized contact Nick or Teresa so that they can download it to the rallye laptop. Once the system is downloaded do not make changes on-line unless you contact Nick or Teresa first. If you are using your own laptop instead of the rallye laptop you will need to export the file and import it on your laptop.


=== Night of the rallye ===
The statistics document lists the fraction of teams in each class that recorded each gimmick.
These statistics can be helpful for rallyemasters trying to understand how difficult different types of gimmicks are, so they can better calibrate future rallyes.


# At the start Nick will transfer the laptop to you and explain set up and start up.
== Rallye Day Data Entry ==
# When doing the scoring if it is slow you can enter all information off scoresheets; car number, class, names, and clubs, but if there is a pile of scoresheets waiting to be scored it is recommended that you only enter car number, class and if they are TRC members.
# Once awards have been handed out Nick and Teresa will take the laptop and upload the rallye information to the website so results can be printed.


=== After the rallye ===
Everything you need to know for night-of operation is in the README files on the two machines. Just boot them up and -- right in the middle of the display -- is the documentation.


# If you didn’t use the system to score the rallye you can use it post rallye to get your results printed. First you will need to set up the scoring profile.
== Everything Else ==
# If you did use the system for scoring once the file has been upload Nick or Teresa will contact you and let you know that it is available.
# Next, you will need to enter any information that wasn’t entered the night of the rallye.
# Once all information is entered you can click on “Results” and you will get a page that you can copy & paste into a text editor.
# If you want to include the stats of the rallye you can click on “Stats” and copy paste them into the text editor as well.
# After creating your results file you will email the results to all contestants, TRC-EVENTS and to Dave Graubart. (Dave will post them to the TRC website.)


== Scoring System Precheck ==
Below is an overview of everything a RM and/or the computer keeper might need to know from start to finish.


After the scoring profile has been created the following precheck should be completed by the rallyemaster and
=== Technical background: ===
at least 1 other person. The scoring system should be configured and prechecked no less then 48 hours prior
to the event. If at anytime there are corrections to the scoring system it needs to be completely rechecked by
the Rallyemaster and the prechecker.


* Compare scoresheet with screen and verify they match.
There is a server at http://rallye.ipidooma.net that allows anyone to create a configuration and use it over the Internet.
* Mark all of the CMs and CPs and hit score. Double check that all impossible combos and prerequisites are correct.
 
* Mark each impossible combo and prerequisite and click score to verify correct scoring.
Historically, our finish locations did not have any kind of internet access, so there needed to be a way to score without it, using the same program in local configuration. For this reason it is possible to export/import a configuration. So if one does not have custody of the scoring laptop, it is possible to configure using the internet version and then ''export'' a configuration file that is then ''imported'' into the laptop version. 
* Hit score with no CMs or CPs marked. Verify that the finish points are correct or that no score is given for this.
 
* Enter what you think is a perfect rallye and hit score. Verify that the total points are correct.
The two laptop machines form their own ''adhoc'' (P2P) WiFi network, that theoretically anyone could join, except that there is no DHCP server, because at the time there were no such things that ran reliably and most hand held devices do not support adhoc mode WiFi.
* Enter no less than 5 samples containing a variety of situations and verify score against a hand score of the same sample. Each prechecker should enter 5 unique samples.
 
The scoring machine runs a LAMP stack, the same as the internet server, and the display machine runs a browser that just points at pages on the scoring machine with the intent that it will be driving a large overhead display. It’s a bit overkill to dedicate a laptop driving a single display with just a web browser, but at the time we bought the laptops, there were no tablets or small-scale, self-contained devices that could connect to an HDMI display.
 
All source code for the scoring program is in clear text PHP. But any changes made on the laptop should be back ported to the internet server to ensure compatibility.
 
=== Creating a Rallye Scoring Profile ===
 
It’s fairly well guided. Connect to either the laptop version or the internet version at [http://www.ipidooma.net/rallye/index.php www.ipidooma.net/rallye/].
 
From here you can
* Recall an existing rallye. There are two “No Password” examples near the bottom of the pulldown list.
* Create a new rallye (scoring definition) by filling in the interesting bits and clicking “Create” then follow the steps.
 
Both the rallyemaster and one other person should precheck the scoring profile.
Do this well in advance of the actual rallye.
 
==== Layout ====
Here you can add separate passwords for configuration and for scoring only. And you define the look of your virtual score sheet to appear similar to your physical one by defining grids to be used as header, body, sidebar, and footer. All sections are optional.
 
==== Names ====
Here you name the elements of your grid. Default names are automatically loaded to try to match the “standard” score sheet. Within each grid element are +/- buttons that allow you increase/decrease the number of options within a single grid element. This can be useful for double/alternate record gimmicks or AB rallyes.
 
==== Values ====
Here the native values of each element are defined. Note: only whole integer values are reported, but elements can have fractional values. This is useful for tie breakers. A tie breaker could be worth 0.1 points which would break the tie between to 990 scoring ME’s by making their scores 990.0 to 990.1 and sorting them properly, but the displayed value will still be 990. It works very well as long as the sum of the TB points is less than 1
 
==== Combos ====
This bit is a tad more complex. Here the native values of elements are overridden when a logical combination is triggered. This can be used to drive values to ZERO in cases where a combination is impossible, or can be used to create a bonus situation where having two elements should be worth more points than having each of them alone. Or perhaps recording Y without having recorded X is senseless and should be worth zero (though remember the case where a beginner merely doesn't see a CM).
 
For example, the native values of CMs A and B are 10 points each, but having A and B together is impossible and therefore results in 0 points for both of them. Or perhaps there is a required combination N alone is 10 points, but N+O is 20, N+P is 30, and O and P alone or together are impossible. It is easy to define a set of rules to make that complex combination happen using a couple of Combo Rules. See “No Password Demo 1” for examples. It also scores N+O+P as -40 points! It describes these as
* '''N,P: (On 2 30pts.)''' meaning "If the set N and P includes at least 2 (i.e., both) on (checked because the score sheet had them recorded), discard their alone scores and score the combo as 30 points.
* '''N,O: (On 2 20pts.)''' meaning "If the set N and O includes at least 2 (i.e., both) on, discard their alone scores and score them as 20 points.
* '''N,O,P: (On 3 -40pts.)''' meaning "If the set N, O, and P includes at least 3 (i.e., all) on, discard their alone scores and score them as -40 points.
Note: Though that is how you enter and read the combos, when the scoring is done, the "alone scores" appear in the CM section and the correction to get to the desired combo sum appears under "Adjustments" later.
 
Try all cases and assure their net effect is correct. This is easy starting from an empty score sheet. If the user only has A, is the score correct? B? Both? Neither?
 
Before the rallye, does a perfect score sheet earn 1000 points (or whatever you intend)?
 
=== Scoring ===
 
1.      On the scoring screen, your definitions become active. You must fill in a car number to differentiate one car from the other but Names and email addresses are optional and can be very time consuming on rallye day. It is also possible here to recall a car that has reported a discrepancy and potentially correct the entries. Sometimes errant clicks cause problems.
 
2.      Select the competition class (FT thru ME)
 
3.      Check off the elements that the rallyist has on the score sheet. It can be done very quickly if you think in terms of patters rather than values. That is, rather than thinking: Has A, Has B, Has C, does not have D, does not have E, has F… Just match the pattern: column 1 starting at the top: has 3, not 2, has 2… Don’t get tied up in the details of the CM, the computer will do that for you.
 
4.      You will notice that some elements are framed in red, this means that the element is part of a combo.
 
5.       Finally click “score” and a report will be given to you showing where points came from or went to in the case of impossible combos.
 
6.      If at this point you realize you made a mistake, you can immediately recall the car, or if everything is good, continue and move on to the next car.
 
 
As you score cars, a scoreboard will start to appear at the bottom of the page, along with statistics regarding the number of cars by class that have marked various elements. If a score board is running, it will automatically pick up changes to scores every 30 seconds or so.
 
=== Protests (tab on scoring screen) ===
 
In classic paper scoring, complex protests were a nightmare; sometimes simple ones were, too. Not any more.  Simply fill in a protest form so it reads like a sentence. That is, fill in the points to be granted, who this protest applies to, and, if necessary, select the conditions, then press Grant. “Grant 10 points to Car #1 for this reason: ‘…’” provided X is missing.
 
For example: If a 10-point protest is being granted to car 1 and no one else, simply fill in the points, the car number, and a short explanations like “Committee agrees with car” then click Grant.
 
If the protest is more complex, such as any car that HAS A and is MISSING B. Select those options from the protest score sheet, fill in the points, leave the car# blank, and write a short description like “combo is invalid”. This will apply those protest points to any car that meets the criteria without having to go through each score sheet one at a time.
 
=== Results (tab on scoring screen) ===
 
Publishing results is quick and easy too. Assuming you have added names and email addresses to the cars, clicking the Results tab will display a preformatted (text) results sheet for you that you can copy/paste into an email. The Addresses of participants is included at the top and should be used in the BCC line. A memory stick (also known as a USB drive, flash drive, or thumb drive) is useful in moving the results from one computer to another for emailing; alternately, if the club is so inclined, an email client could be installed onto the scoring machine.
 
=== Advanced configurations ===
 
The display machine, when it is connected to a TV, actually has two monitors that can either be carbon copies of each other or can be separated with a score board running on the big screen and second scoring station running on the built-in display.
 
Other laptops or tablets can join into the ad hoc network to act as scoring stations and score boards. It is perfectly fine for more than one scoring station to operate at a time, as long as those doing the scoring are not trying to work on the same car at the same time. It is best to have the paper score sheet in hand when working on a car just to be safe.
 
 
== See Also ==
 
* [http://old.therallyeclub.org/pdf/scoring%20program%20precheck.pdf Setting Up the Computerized Scoring Program] (PDF, 52kB) is the official manual for using the computerized scoring system.
* TRC [[Server Computer README]]
* TRC [[Display Computer README]]
* [[Scoring a Rallye by Hand]]

Latest revision as of 11:13, 21 July 2016

Rallyemasters can use Nick Stefanisko's computerized scoring system to score rallyes, to quickly rescore rallyes based on granted protests, and to generate final results and statistics. If given sufficient notice prior to the event, Nick and Teresa Stefanisko can provide a laptop computer for use with the scoring system.

Before using the computerized scoring system, rallyemasters must visit www.ipidooma.net/rallye/ and create a new rallye scoring profile and then precheck it carefully.

It is also possible to use the scoring system to generate results and statistics for a rallye that was scored by hand.

The results document lists each team's score and standing, as well as the names of the driver, navigator, and any passengers (if they were entered).

The statistics document lists the fraction of teams in each class that recorded each gimmick. These statistics can be helpful for rallyemasters trying to understand how difficult different types of gimmicks are, so they can better calibrate future rallyes.

Rallye Day Data Entry

Everything you need to know for night-of operation is in the README files on the two machines. Just boot them up and -- right in the middle of the display -- is the documentation.

Everything Else

Below is an overview of everything a RM and/or the computer keeper might need to know from start to finish.

Technical background:

There is a server at http://rallye.ipidooma.net that allows anyone to create a configuration and use it over the Internet.

Historically, our finish locations did not have any kind of internet access, so there needed to be a way to score without it, using the same program in local configuration. For this reason it is possible to export/import a configuration. So if one does not have custody of the scoring laptop, it is possible to configure using the internet version and then export a configuration file that is then imported into the laptop version.

The two laptop machines form their own adhoc (P2P) WiFi network, that theoretically anyone could join, except that there is no DHCP server, because at the time there were no such things that ran reliably and most hand held devices do not support adhoc mode WiFi.

The scoring machine runs a LAMP stack, the same as the internet server, and the display machine runs a browser that just points at pages on the scoring machine with the intent that it will be driving a large overhead display. It’s a bit overkill to dedicate a laptop driving a single display with just a web browser, but at the time we bought the laptops, there were no tablets or small-scale, self-contained devices that could connect to an HDMI display.

All source code for the scoring program is in clear text PHP. But any changes made on the laptop should be back ported to the internet server to ensure compatibility.

Creating a Rallye Scoring Profile

It’s fairly well guided. Connect to either the laptop version or the internet version at www.ipidooma.net/rallye/.

From here you can

  • Recall an existing rallye. There are two “No Password” examples near the bottom of the pulldown list.
  • Create a new rallye (scoring definition) by filling in the interesting bits and clicking “Create” then follow the steps.

Both the rallyemaster and one other person should precheck the scoring profile. Do this well in advance of the actual rallye.

Layout

Here you can add separate passwords for configuration and for scoring only. And you define the look of your virtual score sheet to appear similar to your physical one by defining grids to be used as header, body, sidebar, and footer. All sections are optional.

Names

Here you name the elements of your grid. Default names are automatically loaded to try to match the “standard” score sheet. Within each grid element are +/- buttons that allow you increase/decrease the number of options within a single grid element. This can be useful for double/alternate record gimmicks or AB rallyes.

Values

Here the native values of each element are defined. Note: only whole integer values are reported, but elements can have fractional values. This is useful for tie breakers. A tie breaker could be worth 0.1 points which would break the tie between to 990 scoring ME’s by making their scores 990.0 to 990.1 and sorting them properly, but the displayed value will still be 990. It works very well as long as the sum of the TB points is less than 1

Combos

This bit is a tad more complex. Here the native values of elements are overridden when a logical combination is triggered. This can be used to drive values to ZERO in cases where a combination is impossible, or can be used to create a bonus situation where having two elements should be worth more points than having each of them alone. Or perhaps recording Y without having recorded X is senseless and should be worth zero (though remember the case where a beginner merely doesn't see a CM).

For example, the native values of CMs A and B are 10 points each, but having A and B together is impossible and therefore results in 0 points for both of them. Or perhaps there is a required combination N alone is 10 points, but N+O is 20, N+P is 30, and O and P alone or together are impossible. It is easy to define a set of rules to make that complex combination happen using a couple of Combo Rules. See “No Password Demo 1” for examples. It also scores N+O+P as -40 points! It describes these as

  • N,P: (On 2 30pts.) meaning "If the set N and P includes at least 2 (i.e., both) on (checked because the score sheet had them recorded), discard their alone scores and score the combo as 30 points.
  • N,O: (On 2 20pts.) meaning "If the set N and O includes at least 2 (i.e., both) on, discard their alone scores and score them as 20 points.
  • N,O,P: (On 3 -40pts.) meaning "If the set N, O, and P includes at least 3 (i.e., all) on, discard their alone scores and score them as -40 points.

Note: Though that is how you enter and read the combos, when the scoring is done, the "alone scores" appear in the CM section and the correction to get to the desired combo sum appears under "Adjustments" later.

Try all cases and assure their net effect is correct. This is easy starting from an empty score sheet. If the user only has A, is the score correct? B? Both? Neither?

Before the rallye, does a perfect score sheet earn 1000 points (or whatever you intend)?

Scoring

1. On the scoring screen, your definitions become active. You must fill in a car number to differentiate one car from the other but Names and email addresses are optional and can be very time consuming on rallye day. It is also possible here to recall a car that has reported a discrepancy and potentially correct the entries. Sometimes errant clicks cause problems.

2. Select the competition class (FT thru ME)

3. Check off the elements that the rallyist has on the score sheet. It can be done very quickly if you think in terms of patters rather than values. That is, rather than thinking: Has A, Has B, Has C, does not have D, does not have E, has F… Just match the pattern: column 1 starting at the top: has 3, not 2, has 2… Don’t get tied up in the details of the CM, the computer will do that for you.

4. You will notice that some elements are framed in red, this means that the element is part of a combo.

5. Finally click “score” and a report will be given to you showing where points came from or went to in the case of impossible combos.

6. If at this point you realize you made a mistake, you can immediately recall the car, or if everything is good, continue and move on to the next car.


As you score cars, a scoreboard will start to appear at the bottom of the page, along with statistics regarding the number of cars by class that have marked various elements. If a score board is running, it will automatically pick up changes to scores every 30 seconds or so.

Protests (tab on scoring screen)

In classic paper scoring, complex protests were a nightmare; sometimes simple ones were, too. Not any more. Simply fill in a protest form so it reads like a sentence. That is, fill in the points to be granted, who this protest applies to, and, if necessary, select the conditions, then press Grant. “Grant 10 points to Car #1 for this reason: ‘…’” provided X is missing.

For example: If a 10-point protest is being granted to car 1 and no one else, simply fill in the points, the car number, and a short explanations like “Committee agrees with car” then click Grant.

If the protest is more complex, such as any car that HAS A and is MISSING B. Select those options from the protest score sheet, fill in the points, leave the car# blank, and write a short description like “combo is invalid”. This will apply those protest points to any car that meets the criteria without having to go through each score sheet one at a time.

Results (tab on scoring screen)

Publishing results is quick and easy too. Assuming you have added names and email addresses to the cars, clicking the Results tab will display a preformatted (text) results sheet for you that you can copy/paste into an email. The Addresses of participants is included at the top and should be used in the BCC line. A memory stick (also known as a USB drive, flash drive, or thumb drive) is useful in moving the results from one computer to another for emailing; alternately, if the club is so inclined, an email client could be installed onto the scoring machine.

Advanced configurations

The display machine, when it is connected to a TV, actually has two monitors that can either be carbon copies of each other or can be separated with a score board running on the big screen and second scoring station running on the built-in display.

Other laptops or tablets can join into the ad hoc network to act as scoring stations and score boards. It is perfectly fine for more than one scoring station to operate at a time, as long as those doing the scoring are not trying to work on the same car at the same time. It is best to have the paper score sheet in hand when working on a car just to be safe.


See Also