目的:评估国际脊柱畸形研究组(Spinal Deformity Study Group,SDSG)推荐的腰骶椎滑脱分型的可信度和可重复性。方法:对2001年1月~2010年1月期间我科收治的符合入选标准的53例发育性和峡部裂性腰骶椎滑脱患者的影像学资料进行回顾分...目的:评估国际脊柱畸形研究组(Spinal Deformity Study Group,SDSG)推荐的腰骶椎滑脱分型的可信度和可重复性。方法:对2001年1月~2010年1月期间我科收治的符合入选标准的53例发育性和峡部裂性腰骶椎滑脱患者的影像学资料进行回顾分析,其中男性12例,女性41例,年龄10~40岁(28.7±10.8岁),每例患者均有完整的术前站立正侧位X线片且均未进行预先测量。由4位脊柱外科医生分别根据SDSG分型标准进行分型,2周后此4位医生分别对这些患者的X线片再次进行分型,收集分型结果,分别作可信度和可重复性分析,计算Kappa值检验一致性。结果:4位医师对53例患者分型的可信度为71.7%~86.8%(Kappa值0.572~0.794),可重复性为83.0%~92.5%(Kappa值0.721~0.891)。滑脱轻、重度分级的可信度和可重复性分别为94.0%(Kappa值0.777)和96.7%(Kappa值0.862)。轻度滑脱患者中分型可信度为86.1%(Kappa值0.744),可重复性为86.6%(Kappa值0.751);重度滑脱患者中分型可信度为83.3%(Kappa值0.693),可重复性为87.5%(Kappa值0.788)。结论:腰骶椎滑脱SDSG分型具有较高的可信度和可重复性,但其在指导手术策略制定中的应用价值尚需进行前瞻性研究进一步检验。展开更多
Estimating reproducibility is often wrongly thought of as basic science. Although it has a significant clinical relevance, its importance is underestimated. It was Al-exander Pope in 1732 who was frst to understand th...Estimating reproducibility is often wrongly thought of as basic science. Although it has a significant clinical relevance, its importance is underestimated. It was Al-exander Pope in 1732 who was frst to understand the value of reproducibility, with his famous comment “Who shall decide when doctors disagree?”. Pope’s question concerns the medical doctors’ opinion on a patient’s status, which from a statistical point of view may be considered a categorical variable. However, the same question may be posed for continuous quantitative variables. Reproducibility is complementary to variabil-ity: the larger the variability, the lower the reproduc-ibility, and vice versa. Thus, we can think at them as interchangeable, even thought statistical methods have been developed for the estimation of variability. The question now is “Why do we need to know the repro-ducibility of measurements? ”. The most important and simplest answer is that we need to know how reliable a measured value or a subjective judgment is before tak-ing clinical decisions based on this measurement/judg-ment. Integrating this knowledge in clinical practice is a key aspect of evidence-based medicine.展开更多
Aims Vegetation sampling employing observers is prone to both inter-observer and intra-observer error.Three types of errors are common:(i)overlooking error(i.e.not observing species actually present),(ii)misidentifica...Aims Vegetation sampling employing observers is prone to both inter-observer and intra-observer error.Three types of errors are common:(i)overlooking error(i.e.not observing species actually present),(ii)misidentification error(i.e.not correctly identifying species)and(iii)estimation error(i.e.not accurately estimating abundance).I conducted a literature review of 59 articles that provided quantitative estimates or statistical inferences regarding observer error in vegetation studies.Important FindingsAlmost all studies(92%)that tested for a statistically significant effect of observer error found at least one significant comparison.In surveys of species composition,mean pseudoturnover(the percentage of species overlooked by one observer but not another)was 10-30%.Species misidentification rates were on the order of 5-10%.The mean coefficient of variation(CV)among observers in surveys of vegetation cover was often several hundred%for species with low cover,although CVs of 25-50%were more representative of species with mean covers of>50%.A variety of metrics and indices(including commonly used diversity indices)and multivariate data analysis techniques(including ordinations and classifications)were found to be sensitive to observer error.Sources of error commonly include both characteristics of the vegetation(e.g.small size of populations,rarity,morphology,phenology)and attributes of the observers(e.g.mental fatigue,personal biases,differences in experience,physical stress).The use of multiple observers,additional training including active feedback approaches,and continual evaluation and calibration among observers are recommended as strategies to reduce observer error in vegetation surveys.展开更多
文摘目的:评估国际脊柱畸形研究组(Spinal Deformity Study Group,SDSG)推荐的腰骶椎滑脱分型的可信度和可重复性。方法:对2001年1月~2010年1月期间我科收治的符合入选标准的53例发育性和峡部裂性腰骶椎滑脱患者的影像学资料进行回顾分析,其中男性12例,女性41例,年龄10~40岁(28.7±10.8岁),每例患者均有完整的术前站立正侧位X线片且均未进行预先测量。由4位脊柱外科医生分别根据SDSG分型标准进行分型,2周后此4位医生分别对这些患者的X线片再次进行分型,收集分型结果,分别作可信度和可重复性分析,计算Kappa值检验一致性。结果:4位医师对53例患者分型的可信度为71.7%~86.8%(Kappa值0.572~0.794),可重复性为83.0%~92.5%(Kappa值0.721~0.891)。滑脱轻、重度分级的可信度和可重复性分别为94.0%(Kappa值0.777)和96.7%(Kappa值0.862)。轻度滑脱患者中分型可信度为86.1%(Kappa值0.744),可重复性为86.6%(Kappa值0.751);重度滑脱患者中分型可信度为83.3%(Kappa值0.693),可重复性为87.5%(Kappa值0.788)。结论:腰骶椎滑脱SDSG分型具有较高的可信度和可重复性,但其在指导手术策略制定中的应用价值尚需进行前瞻性研究进一步检验。
文摘Estimating reproducibility is often wrongly thought of as basic science. Although it has a significant clinical relevance, its importance is underestimated. It was Al-exander Pope in 1732 who was frst to understand the value of reproducibility, with his famous comment “Who shall decide when doctors disagree?”. Pope’s question concerns the medical doctors’ opinion on a patient’s status, which from a statistical point of view may be considered a categorical variable. However, the same question may be posed for continuous quantitative variables. Reproducibility is complementary to variabil-ity: the larger the variability, the lower the reproduc-ibility, and vice versa. Thus, we can think at them as interchangeable, even thought statistical methods have been developed for the estimation of variability. The question now is “Why do we need to know the repro-ducibility of measurements? ”. The most important and simplest answer is that we need to know how reliable a measured value or a subjective judgment is before tak-ing clinical decisions based on this measurement/judg-ment. Integrating this knowledge in clinical practice is a key aspect of evidence-based medicine.
文摘Aims Vegetation sampling employing observers is prone to both inter-observer and intra-observer error.Three types of errors are common:(i)overlooking error(i.e.not observing species actually present),(ii)misidentification error(i.e.not correctly identifying species)and(iii)estimation error(i.e.not accurately estimating abundance).I conducted a literature review of 59 articles that provided quantitative estimates or statistical inferences regarding observer error in vegetation studies.Important FindingsAlmost all studies(92%)that tested for a statistically significant effect of observer error found at least one significant comparison.In surveys of species composition,mean pseudoturnover(the percentage of species overlooked by one observer but not another)was 10-30%.Species misidentification rates were on the order of 5-10%.The mean coefficient of variation(CV)among observers in surveys of vegetation cover was often several hundred%for species with low cover,although CVs of 25-50%were more representative of species with mean covers of>50%.A variety of metrics and indices(including commonly used diversity indices)and multivariate data analysis techniques(including ordinations and classifications)were found to be sensitive to observer error.Sources of error commonly include both characteristics of the vegetation(e.g.small size of populations,rarity,morphology,phenology)and attributes of the observers(e.g.mental fatigue,personal biases,differences in experience,physical stress).The use of multiple observers,additional training including active feedback approaches,and continual evaluation and calibration among observers are recommended as strategies to reduce observer error in vegetation surveys.