Factor validation and Rasch analysis of the individual recovery outcomes counter

Geoffrey L. Dickens, Bridey Rudd, Nutmeg Hallett, Robin M. Ion, Scott M. Hardie

Research output: Contribution to journalArticle

2 Citations (Scopus)
7 Downloads (Pure)

Abstract

Objective: The Individual Recovery Outcomes Counter is a 12-item personal recovery self assessment tool for adults with mental health problems. Although widely used across Scotland, limited research into its psychometric properties has been conducted. We tested its' measurement properties to ascertain the suitability of the tool for continued use in its present form.
Materials and methods: Anonymised data from the assessments of 1,743 adults using mental health services in Scotland were subject to tests based on principles of Rasch measurement theory, principal components analysis and confirmatory factor analysis.

Results: Rasch analysis revealed that the 6-point response structure of the Individual Recovery Outcomes Counter was problematic. Re-scoring on a 4-point scale revealed well ordered items that measure a single, recovery-related construct, and has acceptable fit statistics. Confirmatory factor analysis supported this. Scale items covered around 75% of the recovery continuum; those individuals least far along the continuum were least well addressed.

Conclusions: A modified tool worked well for many, but not all, service users. The study suggests specific developments are required if the Individual Recovery Outcomes Counter is to maximise its' utility for service users and provide meaningful data for service providers.

*Implications for Rehabilitation

*Agencies and services working with people with mental health problems aim to help them with their recovery.

*The individual recovery outcomes counter has been developed and is used widely in Scotland to help service users track their progress to recovery.

*Using a large sample of routinely collected data we have demonstrated that a number of modifications are needed if the tool is to adequately measure recovery.

*This will involve consideration of the scoring system, item content and inclusion, and theoretical basis of the tool.
Original languageEnglish
Pages (from-to)74-85
Number of pages12
JournalDisability and Rehabilitation
Volume41
Issue number1
Early online date11 Sep 2017
DOIs
Publication statusPublished - 2019

Fingerprint

Scotland
Statistical Factor Analysis
Mental Health
Mental Health Services
Principal Component Analysis
Psychometrics
Rehabilitation
Research

Cite this

Dickens, Geoffrey L. ; Rudd, Bridey ; Hallett, Nutmeg ; Ion, Robin M. ; Hardie, Scott M. / Factor validation and Rasch analysis of the individual recovery outcomes counter. In: Disability and Rehabilitation. 2019 ; Vol. 41, No. 1. pp. 74-85.
@article{77882db2a1f849f7936f8526361ff913,
title = "Factor validation and Rasch analysis of the individual recovery outcomes counter",
abstract = "Objective: The Individual Recovery Outcomes Counter is a 12-item personal recovery self assessment tool for adults with mental health problems. Although widely used across Scotland, limited research into its psychometric properties has been conducted. We tested its' measurement properties to ascertain the suitability of the tool for continued use in its present form.Materials and methods: Anonymised data from the assessments of 1,743 adults using mental health services in Scotland were subject to tests based on principles of Rasch measurement theory, principal components analysis and confirmatory factor analysis.Results: Rasch analysis revealed that the 6-point response structure of the Individual Recovery Outcomes Counter was problematic. Re-scoring on a 4-point scale revealed well ordered items that measure a single, recovery-related construct, and has acceptable fit statistics. Confirmatory factor analysis supported this. Scale items covered around 75{\%} of the recovery continuum; those individuals least far along the continuum were least well addressed.Conclusions: A modified tool worked well for many, but not all, service users. The study suggests specific developments are required if the Individual Recovery Outcomes Counter is to maximise its' utility for service users and provide meaningful data for service providers.*Implications for Rehabilitation*Agencies and services working with people with mental health problems aim to help them with their recovery.*The individual recovery outcomes counter has been developed and is used widely in Scotland to help service users track their progress to recovery.*Using a large sample of routinely collected data we have demonstrated that a number of modifications are needed if the tool is to adequately measure recovery.*This will involve consideration of the scoring system, item content and inclusion, and theoretical basis of the tool.",
author = "Dickens, {Geoffrey L.} and Bridey Rudd and Nutmeg Hallett and Ion, {Robin M.} and Hardie, {Scott M.}",
year = "2019",
doi = "10.1080/09638288.2017.1375030",
language = "English",
volume = "41",
pages = "74--85",
journal = "Disability and Rehabilitation",
issn = "0963-8288",
publisher = "Informa Healthcare",
number = "1",

}

Factor validation and Rasch analysis of the individual recovery outcomes counter. / Dickens, Geoffrey L.; Rudd, Bridey; Hallett, Nutmeg; Ion, Robin M.; Hardie, Scott M.

In: Disability and Rehabilitation, Vol. 41, No. 1, 2019, p. 74-85.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Factor validation and Rasch analysis of the individual recovery outcomes counter

AU - Dickens, Geoffrey L.

AU - Rudd, Bridey

AU - Hallett, Nutmeg

AU - Ion, Robin M.

AU - Hardie, Scott M.

PY - 2019

Y1 - 2019

N2 - Objective: The Individual Recovery Outcomes Counter is a 12-item personal recovery self assessment tool for adults with mental health problems. Although widely used across Scotland, limited research into its psychometric properties has been conducted. We tested its' measurement properties to ascertain the suitability of the tool for continued use in its present form.Materials and methods: Anonymised data from the assessments of 1,743 adults using mental health services in Scotland were subject to tests based on principles of Rasch measurement theory, principal components analysis and confirmatory factor analysis.Results: Rasch analysis revealed that the 6-point response structure of the Individual Recovery Outcomes Counter was problematic. Re-scoring on a 4-point scale revealed well ordered items that measure a single, recovery-related construct, and has acceptable fit statistics. Confirmatory factor analysis supported this. Scale items covered around 75% of the recovery continuum; those individuals least far along the continuum were least well addressed.Conclusions: A modified tool worked well for many, but not all, service users. The study suggests specific developments are required if the Individual Recovery Outcomes Counter is to maximise its' utility for service users and provide meaningful data for service providers.*Implications for Rehabilitation*Agencies and services working with people with mental health problems aim to help them with their recovery.*The individual recovery outcomes counter has been developed and is used widely in Scotland to help service users track their progress to recovery.*Using a large sample of routinely collected data we have demonstrated that a number of modifications are needed if the tool is to adequately measure recovery.*This will involve consideration of the scoring system, item content and inclusion, and theoretical basis of the tool.

AB - Objective: The Individual Recovery Outcomes Counter is a 12-item personal recovery self assessment tool for adults with mental health problems. Although widely used across Scotland, limited research into its psychometric properties has been conducted. We tested its' measurement properties to ascertain the suitability of the tool for continued use in its present form.Materials and methods: Anonymised data from the assessments of 1,743 adults using mental health services in Scotland were subject to tests based on principles of Rasch measurement theory, principal components analysis and confirmatory factor analysis.Results: Rasch analysis revealed that the 6-point response structure of the Individual Recovery Outcomes Counter was problematic. Re-scoring on a 4-point scale revealed well ordered items that measure a single, recovery-related construct, and has acceptable fit statistics. Confirmatory factor analysis supported this. Scale items covered around 75% of the recovery continuum; those individuals least far along the continuum were least well addressed.Conclusions: A modified tool worked well for many, but not all, service users. The study suggests specific developments are required if the Individual Recovery Outcomes Counter is to maximise its' utility for service users and provide meaningful data for service providers.*Implications for Rehabilitation*Agencies and services working with people with mental health problems aim to help them with their recovery.*The individual recovery outcomes counter has been developed and is used widely in Scotland to help service users track their progress to recovery.*Using a large sample of routinely collected data we have demonstrated that a number of modifications are needed if the tool is to adequately measure recovery.*This will involve consideration of the scoring system, item content and inclusion, and theoretical basis of the tool.

U2 - 10.1080/09638288.2017.1375030

DO - 10.1080/09638288.2017.1375030

M3 - Article

VL - 41

SP - 74

EP - 85

JO - Disability and Rehabilitation

JF - Disability and Rehabilitation

SN - 0963-8288

IS - 1

ER -