Table 2 Human raters’ rubric

5 Very successful

Speech is extremely well organized and very coherent with detailed information.

A wide range of grammar is used. Attempts to use coordination and subordination to convey ideas very often.

Grammatical errors are absent or very rare.

Speech is extremely smooth. Hesitations rarely occur, and they are very short.

4 Successful

Speech is fairly well organized and coherent.

A fairly wide range of grammar is used. Often attempts to use coordination and subordination to convey ideas.

Grammatical errors are rare.

Speech is fairly smooth. Hesitations very occasionally occur, and they are short.

3 Moderately successful

Speech is somewhat well organized and mostly coherent.

A somewhat wide range of grammar is used. Occasionally attempts to use coordination and subordination to convey ideas.

Grammatical errors sometimes occur.

Speech is somewhat smooth. Hesitations occur occasionally, but they are sometimes lengthy.

2 Poor

Speech is not well organized and is somewhat incoherent.

A limited range of grammar is used. Mostly relies on single clauses and simple phrases.

Grammatical errors often occur.

Speech is disfluent. Hesitations are frequent and often lengthy.

1 Unsuccessful

Speech is very poorly organized and is incoherent.

An extremely limited range of grammar is used. Completely relies on single clauses and simple phrases.

Grammatical errors very often occur.

Speech is very disfluent. Hesitations are very frequent and sometimes very lengthy.