Skip to main content

Advertisement

Springer Nature is making Coronavirus research free. View research | View latest news | Sign up for updates

Table 7 Reliability of the CPIE, Holistic, Analytic, and PIE Method

From: Calibrated Parsing Items Evaluation: a step towards objectifying the translation assessment

Correlations (Evaluators)
  CPIE1 CPIE2 CPIE3 CPIE4 Holistic1 Holistic2 Holistic3 Holistic4 Analytic1 Analytic2 Analytic3 Analytic4 PIE1 PIE2 PIE3 PIE4
Spearman’s rho CPIE1 Correlation Coefficient 1.000 .806 ** .857 ** .896 ** .804** .475** .393* .638** .798** .505** .430** .675** .803** .518** .488** .661**
Sig. (2-tailed) . .000 .000 .000 .000 .002 .012 .000 .000 .001 .006 .000 .000 .001 .001 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
CPIE2 Correlation Coefficient .806 ** 1.000 .911 ** .920 ** .881** .458** .545** .672** .876** .501** .574** .763** .879** .591** .642** .740**
Sig. (2-tailed) .000 . .000 .000 .000 .003 .000 .000 .000 .001 .000 .000 .000 .000 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
CPIE3 Correlation Coefficient .857 ** .911 ** 1.000 .898 ** .866** .505** .452** .591** .855** .540** .480** .683** .855** .615** .563** .671**
Sig. (2-tailed) .000 .000 . .000 .000 .001 .003 .000 .000 .000 .002 .000 .000 .000 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
CPIE4 Correlation Coefficient .896 ** .920 ** .898 ** 1.000 .893** .413** .432** .638** .883** .444** .463** .736** .883** .508** .560** .707**
Sig. (2-tailed) .000 .000 .000 . .000 .008 .005 .000 .000 .004 .003 .000 .000 .001 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Holistic1 Correlation Coefficient .804** .881** .866** .893** 1.000 .502 ** .460 ** .625 ** .990** .541** .493** .716** .987** .619** .572** .694**
Sig. (2-tailed) .000 .000 .000 .000 . .001 .003 .000 .000 .000 .001 .000 .000 .000 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Holistic2 Correlation Coefficient .475** .458** .505** .413** .502 ** 1.000 .314 * .222 .523** .991** .328* .294 .532** .851** .398* .336*
Sig. (2-tailed) .002 .003 .001 .008 .001 . .048 .169 .001 .000 .039 .065 .000 .000 .011 .034
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Holistic3 Correlation Coefficient .393* .545** .452** .432** .460 ** .314 * 1.000 .431 ** .477** .348* .994** .503** .490** .485** .927** .516**
Sig. (2-tailed) .012 .000 .003 .005 .003 .048 . .006 .002 .028 .000 .001 .001 .002 .000 .001
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Holistic4 Correlation Coefficient .638** .672** .591** .638** .625 ** .222 .431 ** 1.000 .609** .258 .451** .909** .604** .395* .501** .881**
Sig. (2-tailed) .000 .000 .000 .000 .000 .169 .006 . .000 .108 .004 .000 .000 .012 .001 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Analytic1 Correlation Coefficient .798** .876** .855** .883** .990** .523** .477** .609** 1.000 .561 ** .513 ** .700 ** .994** .638** .589** .678**
Sig. (2-tailed) .000 .000 .000 .000 .000 .001 .002 .000 . .000 .001 .000 .000 .000 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Analytic2 Correlation Coefficient .505** .501** .540** .444** .541** .991** .348* .258 .561 ** 1.000 .362 * .331 * .571** .886** .434** .374*
Sig. (2-tailed) .001 .001 .000 .004 .000 .000 .028 .108 .000 . .022 .037 .000 .000 .005 .017
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Analytic3 Correlation Coefficient .430** .574** .480** .463** .493** .328* .994** .451** .513 ** .362 * 1.000 .523 ** .526** .505** .935** .534**
Sig. (2-tailed) .006 .000 .002 .003 .001 .039 .000 .004 .001 .022 . .001 .000 .001 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
Analytic4 Correlation Coefficient .675** .763** .683** .736** .716** .294 .503** .909** .700 ** .331 * .523 ** 1.000 .696** .471** .590** .974**
Sig. (2-tailed) .000 .000 .000 .000 .000 .065 .001 .000 .000 .037 .001 . .000 .002 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
PIE1 Correlation Coefficient .803** .879** .855** .883** .987** .532** .490** .604** .994** .571** .526** .696** 1.000 .646 ** .605 ** .687 **
Sig. (2-tailed) .000 .000 .000 .000 .000 .000 .001 .000 .000 .000 .000 .000 . .000 .000 .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
PIE2 Correlation Coefficient .518** .591** .615** .508** .619** .851** .485** .395* .638** .886** .505** .471** .646 ** 1.000 .560 ** .525 **
Sig. (2-tailed) .001 .000 .000 .001 .000 .000 .002 .012 .000 .000 .001 .002 .000 . .000 .001
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
PIE3 Correlation Coefficient .488** .642** .563** .560** .572** .398* .927** .501** .589** .434** .935** .590** .605 ** .560 ** 1.000 .607 **
Sig. (2-tailed) .001 .000 .000 .000 .000 .011 .000 .001 .000 .005 .000 .000 .000 .000 . .000
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40
PIE4 Correlation Coefficient .661** .740** .671** .707** .694** .336* .516** .881** .678** .374* .534** .974** .687 ** .525 ** .607 ** 1.000
Sig. (2-tailed) .000 .000 .000 .000 .000 .034 .001 .000 .000 .017 .000 .000 .000 .001 .000 .
N 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40 40