|
|
|||
|
Chapter 1 |
Preliminaries |
||
| Chapter 2 | Inter-rater agreement: A theoretical framework | ||
| Chapter 3 | Agreement coefficient between 2 raters on a two-level measurement scale | ||
| Chapter 4 | Agreement coefficient between 2 raters on a multiple-level measurement scale | ||
| Chapter 5 | Agreement coefficient between multiple raters on a multiple-level measurement scale | ||
| S-Plus 2000 Functions | fn.AC1.pa | Function returns the overall agreement probability p(a) | |
| fn.AC1.pe | Function returns chance-agreement probability p(e) | ||
| fn.AC1.statistic | Function returns an AC1 estimate | ||
| fn.AC1.cvariance | Function returns the conditional variance of the AC1 estimator | ||
| fn.AC1.uvariance | Function returns the unconditional variance of the AC1 estimator | ||
| SAS Macro | inter-rater.mac | This SAS macro computes the overall generalized kappa statistic of Fleiss (1971) as well as the kappa conditionally on response categories. It also computes the overall AC1 statistic and AC1 conditionally on response categories (see chapter 8 for rater agreement on specific categories). Standard errors are also computed by this macro.. | |
| Data Tables |
(Microsoft xls) |
This is an Excel97 spreadsheet containing the data tables used in the examples discussed in chapter 5 | |
| Chapter 6 |
Jackknife variance estimation |
||
| S-Plus 2000 Functions | fn.pa.replicates | This function computes for each subject (i), the i-th replicate overall agreement probability | |
| fn.pe.replicates | This function computes for each subject (i), the i-th replicate chance-agreement probability | ||
| jackknife.cond | This function computes the conditional jackknife variance of the AC1 statistic | ||
| fn.allocation | The unconditional jackknife variance requires a random assignment of subjects to raters. This function performs that task. | ||
| fn.jackknife | This function computes the unconditional jackknife variance | ||
| Chapter 7 |
Inter-rater reliability under stratified sampling |
||
| S-Plus 2000 Functions | fn.AC1.strat.pa | This function computes the stratified estimate of the overall agreement probability p(a). | |
| fn.AC1.strat.pe | This function computes the stratified estimate of chance-agreement probability p(e) | ||
| fn.AC1.strat.ka | This function computes the stratified AC1 | ||
| fn.replicate.rater.weights | This function computes rater replicate weights | ||
| fn.replicate.subject.weights | This function computes subject replicate weights | ||
| fn.jackknife.strat | Function computes the jackknife variance of the stratified AC1 estimator | ||
| Chapter 8 |
Alternative inter-rater reliability measures |
||
| S-Plus 2000 Functions | fn.ka.grp | This function computes the inter-group reliability gAC1 | |
| fn.var.grp | This function computes the variance of the inter-group reliability gAC1 | ||
| Data Tables | Chapter 8 Tables | This Excel97 workbook contains some data tables used in the examples discussed in chapter 8 | |
| Chapter 9 |
Guidelines for a good reliability study planning |
||
