Tuesday 13 April 2010

Reading summary: Technology in testing : the present and the future

By J Charles Alderson

The writer examined the existing situation on using of IT including CD ROM, Intranet, and Internet in language testing. He talked about the disadvantages of computer-based testing (CBTs) which are as follows:
i) Limited in item types like multiple-choice, cloze and gap-filling only
because of machine scoring.
ii) Limited in testing receptive skills of reading and listening. Productive skills
of speaking and writing can barely be assessed in meaningful way right now.
iii)Test takers with computer illiteracy may suffer from CBTs performance.

The writer also mentioned the technical and pedagogical advantages of computer-based testing which either using the format of diskette, CD ROM or internet.
A. Technical advantages of CBTs:
i) CBTs are more flexible since the delivery date and locations are not limited
ii) Save manpower as no group administration is required because of machine scoring
iii)Save time from travelling, collecting paper and marking
iv) CBTS through internet, results can be available immediately after the test
v) Allow test developers to construct tailor-made tests by templates
vi) Some software like Authorware can easily be used to facilitate test development
vii)Internet can be used for item authoring and reviewing

B. Pedagogic advantages of CBTs:
i) Computer-adaptive testing is more and secure and efficient since it only
presents items that are close to the ability of the user.
ii) CBTs are more user-friendly, it can encourage the integration of testing
directly into teaching and learning and diagnosis by giving user immediate
feedback.
iii)And on-line help, clue, dictionary and multiple-attempt features are available
during test.

The writer also raised 4 examples using CBTs:
i) TOEFL which allows users to see an estimated test result immediately after taking
the test and decide whether to report that result or re-do the test and report
the improved result to the potential receiving institutions.
ii) DIALANG incorporates self-assessment as an integral part of diagnosis and its
immediate feedback not only on score but also on the written benchmarks.
iii)E-rater is also introduced in operation on GMAT essays marking.
iv) PhonePass is used in assessing English L2/ EFL learners’ speaking ability.

Self reflection:
Though I haven’t tried any formal proficiency, placement or diagnostic online testing, it sounds quite efficient, convenience and user friendly; I doubt the reliability of E-rater essay marking.

1 comment:

  1. I have the same experience with you, that is lacking the experience computer-based tests, but the advantages listed in the reading interest me a lot. I think CBTs and traditional tests can be used to access different skills. Like writing and speaking, which are difficult to be accessed in the setting of computer-based environment, are better to be tested in traditional tests.

    ReplyDelete