Documents

Versa Nt Writing Test Validation

Categories
Published
of 30
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Related Documents
Share
Description
A sample of Versant Test
Transcript
  Versant TM  Writing Test Test Description and Validation Summary    © 2013 Pearson Education, Inc. or its affiliate(s). Page 2  of 30   Table of Contents   Table of Contents .......................................................................................................................... 1   1. Introduction ............................................................................................................................... 4   2. Test Description ....................................................................................................................... 4   2.1 Workplace Emphasis .............................................................................................................................................................. 4 2.2 Test Design ............................................................................................................................................................................... 4 2.3 Test Administration ................................................................................................................................................................ 5 2.4 Test Format .............................................................................................................................................................................. 5 Part A: Typing ............................................................................................................................................................................ 5 Part B: Sentence Completion ................................................................................................................................................. 6 Part C: Dictation ....................................................................................................................................................................... 7 Part D: Passage Reconstruction ............................................................................................................................................. 8 Part E: Email Writing ................................................................................................................................................................ 9 2.5 Number of Items ..................................................................................................................................................................... 9 3. Test Construct ........................................................................................................................ 10   3.1 Facility in Written English .................................................................................................................................................... 10   3.2 The Role of Context ............................................................................................................................................................ 12   3.3 The Role of Memory ............................................................................................................................................................ 13   4. Content Design and Development ....................................................................................... 13   4.1 Vocabulary Selection ............................................................................................................................................................. 13   4.2 Item Development ................................................................................................................................................................ 13   4.3 Item Prompt Recording ....................................................................................................................................................... 14   4.3.1 Voice Distribution ......................................................................................................................................................... 14   4.3.2 Recording Review ......................................................................................................................................................... 14   5. Score Reporting ...................................................................................................................... 15   5.1 Scoring and Weighting .......................................................................................................................................................... 15   5.2 Score Use ................................................................................................................................................................................ 17   6. Data Resources for Scoring Development ........................................................................... 17   6.1 Data Collection ...................................................................................................................................................................... 17   6.1.1 Native Speakers ............................................................................................................................................................. 18   6.1.2 Non-Native Speakers ................................................................................................................................................... 18   6.2 Expert Human Rating ........................................................................................................................................................... 18   7. Validation ................................................................................................................................. 19   7.1 Validity Study Design ............................................................................................................................................................ 19 7.1.1 Validation Sample .......................................................................................................................................................... 19 7.2 Structural Validity .................................................................................................................................................................. 20 7.2.1 Descriptive Statistics .................................................................................................................................................... 20 7.2.2 Standard Error of Measurement ............................................................................................................................... 21 7.2.3 Test Reliability ............................................................................................................................................................... 21 7.2.4 Dimensionality: Correlations among Subscores .................................................................................................... 21 7.2.5 Machine Accuracy ......................................................................................................................................................... 22 7.2.6 Differentiation among Known Populations ............................................................................................................. 23    © 2013 Pearson Education, Inc. or its affiliate(s). Page 3  of 30   7.3 Concurrent Validity .............................................................................................................................................................. 24 7.3.1   Versant Writing Test and TOEIC ............................................................................................................................. 24 7.3.2   Versant Writing Test and CEFR Level Estimates .................................................................................................. 25 8. Conclusion ............................................................................................................................... 28   9. About the Company ............................................................................................................... 28   10. References ............................................................................................................................. 29      © 2013 Pearson Education, Inc. or its affiliate(s). Page 4  of 30   1. Introduction   Pearson’s Versant™ Writing Test, powered by Ordinate technology, is a computer-based assessment instrument which is designed to measure how well a person can handle workplace English in written form. The Versant Writing Test is intended for adults 18 years of age and older and takes about 40 minutes to complete. Because the Versant Writing Test is delivered automatically by the Versant testing system, the test can be taken at any time, from any location on a computer. A human examiner is not required. The computerized scoring allows for immediate and objective results that are reliable and correspond well with traditional measures of English language proficiency. The Versant Writing Test measures facility   in written English in the workplace context. Facility is defined as how well a person can understand spoken or written English and respond in writing appropriately on everyday and workplace topics at a functional pace . Versant Writing Test scores provide reliable information that can be applied to placement, qualification and certification decisions by academic institutions, businesses and government agencies. The test is also appropriate for monitoring progress as well as measuring instructional outcomes. (The Versant English Test 1  is also available if it is necessary to evaluate spoken English.) 2. Test Description   2.1 Workplace Emphasis The Versant Writing Test is designed to measure the candidate’s ability to understand and use English in workplace contexts. The test does not target language use in one specific industry (e.g., banking, accounting, travel, health care) or job category (e.g., shop clerks, accountant, tour guide, nurse) because assessing the candidate’s English ability in such specific domains requires both English ability and content knowledge, such as subject matter knowledge or job-specific terminology. Rather, the Versant Writing Test is intended to assess how well and how efficiently the candidate can process written English on general topics such as scheduling, commuting, and training that are commonly found in the workplace regardless of industry or job category. 2.2 Test Design The Versant Writing Test has five tasks: Typing, Sentence Completion, Dictation, Passage Reconstruction, and Email Writing. All items in the Versant Writing Test elicit responses from the candidate that are analyzed automatically. These item types provide multiple, fully independent measures that underlie facility in written English, including sentence comprehension and construction, passive and active vocabulary use, and appropriateness and accuracy of writing. Because more than one item type contributes to many of the subscores, the use of multiple item types strengthens score reliability. The Versant Writing Test score report is comprised of an Overall score and five diagnostic subscores: ã   Grammar ã   Vocabulary ã   Voice & Tone ã   Organization ã   Reading Comprehension 1  For more information about the Versant English Test, please refer to Versant English Test: Test Description and Validation Summary  .
We Need Your Support
Thank you for visiting our website and your interest in our free products and services. We are nonprofit website to share and download documents. To the running of this website, we need your help to support us.

Thanks to everyone for your continued support.

No, Thanks