The effect of appraisers in estimating metabolic rate with the Edholm scale

A study was made of the appraisers' effect on the estimation of metabolic rate with the Edholm scale and a table of the ISO 7243 heat stress standard. The appraisers, five experienced and five inexperienced persons, estimated the metabolic rate of three different work tasks from videotapes. Analysis of variance indicated significant (p < 0.001) differences in the appraisers' recordings of the activities. The appraisers were grouped according to the similarity of the estimated values they gave. The groups thus contained both experienced and inexperienced appraisers, and it was not possible to classify the appraisers into experienced and inexperienced groups according to their earlier experience. The metabolic rates according to the Edholm scale were higher than according to the ISO 7243 table. The differences in metabolic rates given by the individual observers varied from 38 to 118 W/m². The variations in the estimation of metabolic rates were greater when the Edholm scale was used. This variation caused considerable variation also in the predicted mean vote, PMV index. It is recommended that the appraisers be selected carefully, because it is not possible to know whether a randomly selected appraiser is an 'average' or an 'extreme' appraiser without a test. Before conducting extensive field surveys where several appraisers estimate the metabolic rates, it would be useful to arrange training in order to calibrate the levels of the Edholm scale as well as ISO method among the appraisers because training clearly unified the estimation.