What are the commonly used terms for scoring that I should be familiar with?
The following are the commonly used terms:
- Batch: a predefined number of student responses to a test question (Each batch is expected to take an average of one hour to score.)
- Rolling Batch: a set number of scored batches used to calculate the scorer’s average validity of those batches (This average is used to compare against the minimum validity threshold.)
- Item: a question or task that appears on an assessment or test
- Online System: the e-assessment scoring system
- Practice Module: the training session, practice test and qualifying test
- Qualifying Test: the test used to assess a scorer’s ability to accurately score student responses
- Scoring Activity: a time period within a scoring window in which certain tasks are designated to be scored
- Scoring Window: a specific time period (with a start and end date) during which the online system is available for scoring
- Validity: the measure by which scorer accuracy is determined
- Cumulative Validity Incentive Threshold: the final average validity attained during the scoring activity that is needed for scorers to receive incentive payment
- Minimum Validity Threshold: the minimum average rolling validity required to continue to score without having to be retrained
- Average Rolling Validity: the average validity achieved on the rolling batches (This average is used for comparison against the minimum validity threshold, which is required for scorers to be able to score).
What is the new scoring process?
Training and scoring will be self-directed through an online system, which will be available 24 hours a day, 7 days a week during a specific time period referred to as a scoring window. This means that you can participate at your own time and from any location if you meet the necessary technical requirements and qualifications.
All the resources required for training will be available in the online system. Once you have completed your training and passed your qualification test on the online system, you will be able to select 1–3 batches, for which you will have 24 hours to complete. A batch is estimated to take an average of one hour to score.
Please do not select any batches unless you are able to score them in the 24-hour period. If you complete your selected batches before the 24-hour period expires, you can select an additional batch (or batches), for which you will have another 24 hours to complete. Online scoring is self-directed. You do not need to score daily as long you score a minimum of seven batches per week during the entire scoring window and meet the minimum rolling validity threshold. This is outlined in the Confidentiality, Non-Disclosure and Employment Agreement for an EQAO Scorer (Online) or Committee Member (Online) document. If on one occasion you fall below the minimum validity threshold, you will have the opportunity to retrain and pass the qualification test again. If you are successful, you will be able to continue scoring. Otherwise, you will not be able to score and will need to withdraw from the scoring activity.
You can score as many batches as are available, but you should not exceed 44 hours in a work week (Sunday to Saturday).
What happens after I confirm a position?
You will receive an e-mail from email@example.com two days prior to the start of your scoring window. The e-mail will contain a link that will allow you to register for an account on the e-assessment scoring system. Check your spam or junk folders if you have not received the e-mail.
You can add this e-mail address firstname.lastname@example.org to your safe senders list. If you have not received the e-mail one day prior to the scoring activity, please contact 1-888-887-3882. Once registered, you will get access to the e-assessment scoring system.
When I log in to the e-assessment scoring system, I don’t see any batches to score. What does this mean?
The system updates in real time. This means that as schools are still administrating the test, student responses are being captured and uploaded into the system. Batches can become available at any time during the scoring window. Please check back at your next available time.
What is my pay?
Please refer to the Payment Guidelines for details on remuneration.
I used to have an EQAO account that I accessed with a marker PIN. What is my User ID?
User accounts created prior to September 2014: if you used to access your EQAO profile using your marker PIN, your new User ID is the e-mail address that was associated with your marker account. Your password remains the same. If the e-mail address associated with the old account is no longer being used, you can change it once you are logged into your profile. Ensure that the new address has not been entered in the “alternate e-mail address” field on your contact information page. Then change your User ID. If you are not able to access the account, contact EQAO. Do not attempt to create a new account. User accounts created as of September 2014: the e-mail address you used when you created your profile is your User ID.
What is my password?
If you cannot remember your password, click “Forgot Password,” and an e-mail will be sent to you with instructions on how to reset your password. If you no longer have access to the e-mail account on file with EQAO, please contact EQAO.
What if the name used in my EQAO profile doesn’t match the name in my Ontario College of Teachers (OCT) profile?
Your name in your EQAO profile must match the name used in your profile on the OCT Web site. As EQAO’s database is linked with OCT’s, a non-matching name will create communication errors between the two sites. You can try adding your middle name to either the first-name field or the last-name field one at a time to see if this helps to rectify the error. Otherwise, please take action to ensure that your name is the same in both profiles.
How can I tell if scoring opportunities are no longer available at the moment?
Some scorers may have received an invitation to score or multiple invitations to score only to discover that scoring opportunities are no longer available at the moment. This is because the scoring positions that were available have been filled quickly, and there are no more scoring opportunities at the moment. Applicants should keep checking their EQAO profiles, as scoring positions can become available at any time.
Does EQAO fill scoring positions on a first-come, first-served basis?
Yes. There is a limited number of scoring positions. As applicants accept offers to score, the scoring positions are filled quickly on a first-come, first-served basis. Sometimes additional scoring positions are added, or scoring positions can become available if scorers withdraw from their previously accepted scoring positions. Applicants should keep checking their EQAO profiles, as scoring positions can become available at any time.
How do I know if I have been invited to score?
Why didn’t I get an offer to score?
What happens to my chances of receiving scoring offers if I make changes to my EQAO profile?
Some scorers, upon making changes to their EQAO profile, may find that a scoring opportunity is no longer available to them. This is a normal occurrence, as the automated system verifies that the details, qualifications and current employment status in an applicant’s EQAO profile match the requirements for the scoring position. As a result, it is important that a scorer’s profile be maintained with accurate information regarding address, qualifications, current role in education, experience, etc.
How many offers to score can I accept?
You can accept as many scoring offers as you want, as long as the dates do not conflict with one another. Once you accept a scoring opportunity, you will not be able to accept another if the dates conflict with the dates of the offer that you have already accepted.Please note: In some cases, you will only be permitted to accept one session in the initial round of invitations. If scoring opportunities are still available, you may receive notice to accept a second session.
Why am I seeing more than one scoring opportunity on my EQAO profile dashboard page?
You have qualified for more than one scoring position. You may accept as many of the scoring opportunities that you want, as long as the dates do not conflict with one another. If the dates conflict, please select and accept only the scoring offer that you prefer. To accept an offer to score, click “Accept/Decline Position” beside the scoring position on your profile dashboard page, then click “Accept” and continue on in the process until you hit “Confirm.”
How do I decline an invitation to score after I have already accepted it?
Log in to your EQAO profile, and then locate the offer you wish to decline on your profile dashboard page. Next, click “Details,” and then click “Withdraw.”
What if I want to change a particular task that I have been offered?
Unfortunately, EQAO cannot offer changes to the task you have been offered at this time.
How can I view the scoring offers that I have accepted?
Log in to your EQAO profile. All of the scoring opportunities that you have accepted are listed under “Status” on your profile dashboard page. For more information about each opportunity, click “Details” beside each scoring opportunity.
What happens if I am no longer able to score after I have already accepted an invitation to score?
What if I am not sure if I can participate in scoring this year?
Do not accept any invitation to score until you can commit to the scoring opportunity.
How do I request my Record of Employment?
I participated in EQAO activities and I need a T4.
I am a faculty of education student. How can I make sure that I am invited to scoring and assessment committees?
You need to update your proof of enrollment in each year of your program. Once you receive your Ontario College of Teachers (OCT) certificate and your information is on the OCT website, make sure that you update your current educator role and enter the OCT number in your EQAO profile. Ensure your first name and last name match exactly what is on the OCT website.
How can I make sure that I am paid on time?
You must go to drakehire.com to complete or verify your payroll information prior to the event. Failure to do so may result in payment delays.