US6234806B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for interactive scoring of standardized test responses
Assignee: Educational Testing Service
•
Filing: 2000-01-21
•
Granted: 2001-05-22
•
Expires: 2020-01-21
Abstract
Abstract A system and associated method for interactively scoring standardized test responses. The system maintains a database of tests, items that make up the tests, and features that make up the items. A user of the system requests a list of items in the database, and the system responds by presenting a list from which the user selects a plurality of items to be scored. The user selects a scoring mode, and the system scores the selected items according to the selected scoring mode. In an interactive scoring mode, the system scores the features of a selected item and presents to the user the feature scores, as well as an overall item score computed based on these feature scores. The user either accepts the scores as presented, changes one or more feature scores, or changes the overall item score. The system then rescores the item based on the user-entered scores and stores the new score in the database. This process is repeated for the remaining selected items. The user can interrupt one scoring mode and change to another at any time.
Inventors
- 👤 Harriet Priscilla Trenholm
- 👤 Daniel Israel Zuckerman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 19:24
CPC Classifications
G; G09; G09B; G09B7/00; G09B7/06; G09B7/066; G09B7/02; G09B7/04
Claims Analysis
Total Claims: 13
Claim 1
Independent Claim
123 words
A system for scoring responses to standardized tests, each test having at least one item, the system comprising: a scoring subsystem; and a plurality of scoring engines coupled to the scoring subsystem, wherein each scoring engine is associated with a selected item and at least one of the scoring engines is coupled to the scoring subsystem via an applet, the scoring subsystem scores a plurality of selected items by calling, for each selected item, the scoring engine associated with the selected item to determine an item score for the selected item based on a predefined scoring rubric associated with the selected item, and the scoring engine associated with the selected item provides the item score for the selected item to the scoring subsystem.
Claim 2
Independent Claim
123 words
A system for scoring responses to standardized tests, each test having at least one item, the system comprising: a scoring subsystem; and a plurality of scoring engines coupled to the scoring subsystem, wherein each scoring engine is associated with a selected item and at least one of the scoring engines is coupled to the scoring subsystem via an applet, the scoring subsystem scores a plurality of selected items by calling, for each selected item, the scoring engine associated with the selected item to determine an item score for the selected item based on a predefined scoring rubric associated with the selected item, and the scoring engine associated with the selected item provides the item score for the selected item to the scoring subsystem.
Claim 3
Dependent Claim
77 words
The system of claim 1 , wherein the scoring subsystem is an interactive scoring subsystem that scores the selected items by: calling a first scoring engine associated with a first selected item to determine a first item score for the first selected item, storing the first item score, providing the first item score for display to a user, accepting a changed item score from the user, and storing the changed item score for the first selected item.
Claim 4
Dependent Claim
15 words
The system of claim 1 , wherein the scoring subsystem continuously scores the selected items.
Claim 5
Dependent Claim
69 words
The system of claim 1 , wherein the scoring subsystem is an alarm scoring subsystem that scores the selected items by: calling a first scoring engine associated with a first selected item to determine a first item score for the first selected item, determining whether the first item score is valid, and, if the first item score is determined not to be valid, communicating an alarm to a user.
Claim 6
Dependent Claim
48 words
The system of claim 1 , wherein the scoring subsystem is a sampling scoring subsystem that scores the selected items, and provides the item scores for a subset of the selected items for display to a user, wherein the subset is determined by a predefined item sampling period.
Claim 7
Dependent Claim
39 words
The system of claim 1 , further comprising: an item selection subsystem coupled to the scoring subsystem that creates a list that includes the plurality of selected items to be scored and provides the list to the scoring subsystem.
Claim 8
Dependent Claim
31 words
The system of claim 6 , further comprising: an operator workstation coupled to the item selection subsystem via which a user can select the plurality of selected items to be scored.
Claim 9
Independent Claim
144 words
A system for scoring responses to standardized tests, each test having at least one item, the system comprising: a scoring subsystem; and a plurality of scoring engines coupled to the scoring subsystem, wherein each scoring engine is associated with a selected item, the scoring subsystem scores a plurality of selected items by calling a first scoring engine associated with a first selected item to determine a first item score for the first selected item based on a predefined scoring rubric associated with the first selected item, storing the first item score, providing the first item score for display to a user, accepting a changed item score from the user, and storing the changed item score for the first selected item, and the scoring engine associated with the first selected item provides the changed item score for the first selected item to the scoring subsystem.
Claim 10
Independent Claim
144 words
A system for scoring responses to standardized tests, each test having at least one item, the system comprising: a scoring subsystem; and a plurality of scoring engines coupled to the scoring subsystem, wherein each scoring engine is associated with a selected item, the scoring subsystem scores a plurality of selected items by calling a first scoring engine associated with a first selected item to determine a first item score for the first selected item based on a predefined scoring rubric associated with the first selected item, storing the first item score, providing the first item score for display to a user, accepting a changed item score from the user, and storing the changed item score for the first selected item, and the scoring engine associated with the first selected item provides the changed item score for the first selected item to the scoring subsystem.
Claim 11
Dependent Claim
23 words
The system of claim 8 , wherein at least one of the scoring engines is coupled to the scoring subsystem via an applet.
Claim 12
Dependent Claim
39 words
The system of claim 8 , further comprising: an item selection subsystem coupled to the scoring subsystem that creates a list that includes the plurality of selected items to be scored and provides the list to the scoring subsystem.
Claim 13
Dependent Claim
31 words
The system of claim 10 , further comprising: an operator workstation coupled to the item selection subsystem via which a user can select the plurality of selected items to be scored.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-05-21 | 2004-11-20 | 2005-05-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-05-21 | 2008-11-20 | 2009-05-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-05-21 | 2012-11-20 | 2013-05-22 | $7700.00 | Window Closed / Lapsed |