Validity and Reliability of the Italian Version of the Functioning Assessment Short Test (FAST) in Bipolar Disorder
Abstract
Background:
Functioning Assessment Short Test (FAST) is a brief instrument designed to assess the main functioning problems experienced by psychiatric patients, specifically bipolar patients. It includes 24 items assessing impairment or disability in six domains of functioning: autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time. The aim of this study is to measure the validity and reliability of the Italian version of this instrument.
Methods:
Twenty-four patients with DSM-IV TR bipolar disorder and 20 healthy controls were recruited and evaluated in three private clinics in Cagliari (Sardinia, Italy). The psychometric properties of FAST (feasibility, internal consistency, concurrent validity, discriminant validity (patients vs controls and eutimic patients vs manic and depressed), and test-retest reliability were analyzed.
Results:
The internal consistency obtained was very high with a Cronbach's alpha of 0.955. A highly significant negative correlation with GAF was obtained (r = -0.9; p < 0.001) pointing to a reasonable degree of concurrent validity. FAST show a good test-retest reliability between two independent evaluation differing of one week (mean K =0.73). The total FAST scores were lower in controls as compared with Bipolar Patients and in Euthimic patients compared with Depressed or Manic.
Conclusion:
The Italian version of the FAST showed similar psychometrics properties as far as regard internal consistency and discriminant validity of the original version and show a good test retest reliability measure by means of K statistics.
BACKGROUND
The measure of the functional status in Bipolar Disorders is becoming a real challenge in the today research [1]. Early emotional abnormalities and poor premorbid functioning tend to occur in BD [2,3]; however, adequate psychosocial adjustment prior to the first manic episode is also common [4-6]. Moreover, after illness onset, many people with BD regain psychosocial functioning [7], yet others suffer some extent of functional decline, which progresses from a state of psychosocial adjustment to a state of disability [7, 8]. In fact in contrast to early observation carried out by Kraepelin [9], recent studies do not describe such a favourable outcome in patients with bipolar disorder [10-13]. Tohen et al. (2000) [14] found that only 37.6% of bipolar patients achieved functional recovery 24 months after admission. Not surprisingly, BD has been estimated as one of the five most burdensome disorders at the individual level all over the world [15]. Whereas some people with BD is able to accomplish historical landmarks in human achievement [16, 17], others experience significant difficulties in performing daily routines [18]. The remarkable functional variability in BD highlights an inherent prognostic complexity [19-23]. Many studies have clarified several aspects of illness progression in BD [24], yet significant improvement to functional outcome may require further theoretical and clinical advancement [25].
The FAST (Functioning Assessment Short Test) [1] was developed for the clinical evaluation of functional impairment of patients suffering from mental disorders particularly bipolar disorder. The 24 items of the scale are divided among 6 specific areas of functioning: autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time. Taking into consideration the opinion of experts the performance of previous scales and the literature, the aforementioned items were identified as the main problems experienced by people suffering from severe mental disorders, including bipolar patients [26-28].
The FAST showed good psychometric properties as validity and reliability and it was sensitive to different mood states in Bipolar Patients [1]. It is a simple interview, which requires a short period of time for administration and it was found easy to apply [1]. The measure of specific domains of functioning impairment may be of interest in the assessment of supplemental interventions targeting rehabilitation/-functional enhancement of BD patients. FAST may also be useful in assessing the effect of pharmacologic and psychosocial interventions on functioning of bipolar patients.
The purpose of the present study was to validate the Italian version of the FAST for its use as an instrument to assess functional impairment in subjects with bipolar disorder.
METHODS
1. Subjects
Twenty-four bipolar patients were selected and evaluated in three private clinics in Cagliari, Italy. Diagnosis were conducted according to the Structured Clinical Interview for the DSM-IV TR criteria (SCID-DSM-IVTR) [29]. 20 healthy controls were also selected. The healthy comparison group was recruited from the general population within the catchment area of Cagliari. The study was approved by the Università Europea del Mediterraneo Onlus Ethics Committee and was carried out in compliance with the Helsinki Declaration of 1975 (the Evaluation, Support and Prevention Unit). All subjects contacted were informed about the study and if they decide to participate they signed a consensus form. All subject remaining stable for at least one week, according to YMRS, HDRS-17 and GAF (twenty-two patients and all controls), participated in a Test-Retest reliability assessment one week later and were included in the study.
2. Assessment and Instruments
The clinical researchers were preliminary trained in the use of the study tools. One clinical researcher recorded the socio-demographic and clinical variables of each patient, administered the SCID-DSM-IVTR and the Italian version of the Young Mania Rating Scale (YMRS) [30], the Italian version of the 17-item Hamilton Depression Rating Scale (HDRS-17) [30] and the Global Assessment Functioning (GAF) [31] to confirm the stability of the patient's condition and overall functioning. She also recorded all the medication prescribed to the patient for each visit. Finally, a second researcher administered the FAST. Interviewers administering the FAST and the GAF were blinded to each other. The control subjects were screened using the SCID (DSM-IV TR) to exclude current or lifetime psychiatric disorders. Controls had no first-degree relatives with bipolar disorder or other psychiatric disorders. All the study tools out if the SCID interview were re administered a week later. This methodology replicated the original validation study in Spain [1].
3. Fast
The FAST was developed by the Bipolar Disorder Program, Barcelona, Spain. It is an interviewer-administered instrument which is designed to be used by a trained clinician; the studied time frame refers to the last 15 days before assessment. It comprises 24 items, which are divided among 6 the specific areas of functioning. All of items are rated using a 4-point scale, 0 = no difficulty, 1 = mild difficulty, 2 = moderate difficulty and 3 = severe difficulty. The global score is obtained when the scores of each item are added up. The higher the score, the more serious the difficulties are, so FAST is actually measuring disability [1].
The original version was translated in Italian to Spanish back translated and approved by a Spanish native speaker working as researchers in the field of bipolar disorder.
A more detailed description of the instrument is shown in the original paper of Rosa et al [1]. Besides the Italian version is included in the current paper as an Appendix. The use of this tool is free under the terms of the Creative Commons Attribution non-commercial License (http://creative-com-mons.org/licenses/by-nc/3.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, providing that the work is properly cited.
4. Psychometrics
We analyzed the feasibility, internal consistency, concurrent validity, validity as a discriminative measure to detect difference between cases and controls and euthymic and acute patients, and test-retest reliability of the FAST. Except for test-retest reliability measured by means of the K value, the psychometric characteristics of the FAST are derived from the first administration of the questionnaire, including all the subjects who completed it in the analysis.
5. Statistical Analysis
Statistical analysis was performed using SPSS for Windows – Version 11.0 (SPSS Inc., Chicago, IL, USA). Pearson's correlation coefficient was performed to examine the correlation between FAST and GAF scores (for t0 and t1 performances) and between t0 and t1 scores for GAF, FAST total score and specific areas scores, HDRS and YMRS.
The GAF was chosen as the scale to assess concurrent validity of the FAST because it the main instrument for assessing functional outcome in mental disorders. Internal consistency was analyzed using the Cronbach's alpha. The inter-rater reliability of the FAS was measured comparing to and t1 total using both the correlation coefficient of Pearson and the K Cohen’s value. Total scores of FAST of three groups (non patient, euthymic, manic and depressed) were compared using a one-way ANOVA.
RESULTS
Twenty-two bipolar patients (13 BP I, 19 BP II) and 20 healthy controls were included in the study. The bipolar sample included 14 women (63.6%) whilst this rate was similar (12 women, 60%) in the control group. Ten (45.4%) of the patients were considered to be euthymic , 6 (27.3%) were depressed and another 6 (27.3%) presented a manic or mixed episode at study entry. Two manic patients both women and manic at the first evaluation (aged 35 and 52) were excluded because they didn’t remain stable for a week.
The mean age in the patients group was 43.95 years (SD: 12.61, median 47, ranging from 19 to 65) whilst the mean age of the controls was 43.35 years (SD:12.32, median 47, ranging from 19 to 68). There were no significant differences between the two groups regarding demographic baseline variables. Table 1 describes the main socio-demographic and clinical characteristics of the sample and the scores at HDRS, Young Mania Rating Scale and GAF at the two evaluation times, showing the stability between times of the score in both cases and controls of the three tools. Data indicated also a higher difference between case and controls in the HDRS, Young Mania Rating Scale and GAF at the two assessments. The stability between times was found by calculating the correlation between scores at t0 and t1 for the three tools. The P correlation coefficient was r=0.93 (82 df, p<0.001) for HDRS; r=0.78 for Young Mania rating scale(82 df, p<0.001); and r=0.95 for GAF scores (82 df, p<0.001).
Bipolar Patients | Control Group | Statistics between Groups | |||
---|---|---|---|---|---|
Mean | SD | Mean | SD | ||
Age | 43.95 | 12.61 | 43.35 | 12.35 | ANOVA 1 way (1,40,41 df )F=0.023, P<0.880 |
Sex (female) | 14 (63.6%) | 12 (60%) | |||
Age of onset | 27.22 | 8.64 | |||
HDRS t0 | 11.80 | 7.65 | 0.75 | 1.13 | ANOVA 1 way (1,40,41 df )F=40.81, P<0.001 |
HDRS t1 | 11.36 | 9.20 | 0.90 | 1.25 | ANOVA 1 way (1,40,41 df )F=24.75, P<0.001 |
YMRS to | 4.40 | 4.41 | 0.90 | 1.25 | ANOVA 1 way (1,40,41 df )F=11.71, P<0.001 |
YMRS t1 | 4.45 | 3.85 | 1.05 | 1.95 | ANOVA 1 way (1,40,41 df )F=12.26,, P<0.001 |
GAFto | 61.14 | 11.29 | 88.75 | 6.00 | ANOVA 1 way (1,40,41 df )F=95.05, P<0.0001 |
GAF t1 | 64.72 | 11.98 | 86.50 | 7.36 | ANOVA 1 way (1,40,41 df )F=49.16, P<0.0001 |
Statistics between times: HDRS in cases ANOVA 1 way 1,42, 43 df; F=0.03; p=0.856
HDRS in controls ANOVA 1 way 1,38.39 df; F=0.37; p=0.543
Young Mania in cases ANOVA 1 way 1,42, 43 df; F=0.002; p=0.978
Young Mania in controls ANOVA 1 way 1,38.39 df; F=0.84; p=0.774
GAF in cases ANOVA 1 way 1,42, 43 df; F=1.04; p=0.31
GAF in controls ANOVA 1 way 1,38.39 df; F=1.12; p=0.29
Cronbach's Alpha | 0,955704223 |
---|---|
Split-Half (odd-even) Correlation | 0,931926379 |
Spearman-Brown Prophecy | 0,964763864 |
Mean for Test | 18,42857143 |
Standard Deviation for Test | 19,36017372 |
KR21 | 1,031568257 |
KR20 | 1,034981148 |
Item | Kappa Value | Standard Error |
---|---|---|
1 | 0.88 | 0.15 |
2 | 0.57 | 0.15 |
3 | 0.62 | 0.15 |
4 | 0.64 | 0.15 |
Autonomy (1-4) | 0.72 | 0.08 |
5 | 0.94 | 0.15 |
6 | 0.83 | 0.15 |
7 | 0.89 | 0.15 |
8 | 0.73 | 0.14 |
9 | 0.77 | 0.15 |
Work Functioning (5-9) | 0.83 | 0.06 |
10 | 0.55 | 0.13 |
11 | 0.72 | 0.15 |
12 | 0.69 | 0.15 |
13 | 0.60 | 0.15 |
14 | 0.49 | 0.14 |
Cognitive Functioning (10-14) | 0.62 | 0.07 |
15 | 0.60 | 0.14 |
16 | 0.92 | 0.15 |
Money Management (15-16) | 0.76 | 0.11 |
17 | 0.82 | 0.15 |
18 | 0.77 | 0.15 |
19 | 0.73 | 0.14 |
20 | 0.89 | 0.15 |
21 | 0.69 | 0.15 |
22 | 0.84 | 0.15 |
Interpersonal Relationship (17-22) | 0.79 | 0.06 |
23 | 0.68 | 0.15 |
24 | 0.61 | 0.14 |
Free Time (23-24) | 0.74 | 0.11 |
Overall FAST | 0.75 | 0.03 |
All items of the FAST were answered by 98% by the patients and controls (n = 42) in every test session. The mean time spent in completing the instrument was 6.15 +/- 1.12 minutes.
The internal consistency coefficient obtained was high, Cronbach's alpha of 0.9557 (Table 2), for the total scale, indicating that the items are sufficiently homogeneous. With split half methodology the consistency remains high performing a Cronbach’s alpha of 0.9132.
The test re-test reliability of the FAS was measured comparing t0 and t1 scores using both the correlation coefficient of Pearson and the K value. The correlation between the total scores for each subject at t0 and t1 shows a Pearson correlation coefficient of r=0.97 (82 df; p<0.0001) (Fig. 1). A similar correlation was found also taking in to account the scores at the specific areas of the FANS: Fast Autonomy r=0.87; Fast Work r=0.87; Fast Cognition r=0.80; Fast Financial r=0.87; Fast Social Relationship r=0.92; Fast Free Time r=0.86, for all these measures the correlations were statistically significant (df 82, p<0.0001).
Table 3 show the test re-test reliability measured by means of the K of Cohen statistics of each item of the FAST; the mean K of each specific area and as the mean K of the overall scale. The mean of the K of each items performed an agreement of K=0.75 (ES 0.03) in the two measures. The poor agreement was show for item 14 (K=0.49, ES 0.14); the better agreement for item 5 (K=0.94, ES 0.15).
Concurrent validity based on functional impairment according to GAF scale showed a highly significant negative correlation (r = -0.862; p < 0.001 at the first evaluation and r=-0.791 at the second evaluation) (Fig. 2). This result indicates that patients with good functioning assessed using the FAST obtained higher scores on the GAF scale. Accordingly GAF scores indicated adjustment whereas FAST scores showed disability. The total GAF scores were found also to have negative correlation to each specific FAST areas: Autonomy (r=-0.76, p<0.0001; 2) Occupational functioning (r=-0.70 p<0.001); 3) Cognitive functioning (r=-0.63, p<0.0001); 4) Capacity of managing the finances (r=-0.37, p<0.37, p<0.001); 5) Interpersonal relationships (r=-0.86, p<0.0001); 6) Leisure Time (r=-0.68, p<0.0001).
Validity was assessed using a discriminant measure to detect differences between bipolar patients and controls and euthymic and acute patients. The mean scores of FAST were higher in bipolar acutely ill patients compared to euthymic (32.13 ± 16.20 vs 1.73±1.88; F = 50.03; 1,42,43 df; p < 0.001). The mean scores of FAST were lower in euthymic patients (26.20 ± 9.41, F = 4.96; 1,20,21 df; p < 0.038), as compared with manic (38.83 ± 13.72, ) and depressed patients (36.33±13.59). Using a cut off of 11, as indicated by the previous validation study, the discrimination between euthymic and depressed and manic patient have a sensitivity of 100% but a specificity of only 30%; with an higher cut off (21) the accuracy improved with sensitivity of 83% and specificity of 60%.
DISCUSSION
The results of the present study show that the Italian version of the FAST has similar psychometrics properties regarding internal consistency and discriminant validity of the original version and show a good test-retest reliability measured by K statistics.
After their first validation study [1], the FAST has become a well-known international tool and it has been translated and validated into several languages [32]. The introduction of this instrument partly fills the existing gap on the need of proper assessment of the functional burden associated to bipolar disorders. It also helps measuring the relationship between the functioning in specific areas and the relationship of social functioning with clinical variables as, for example, early vs late stage of disease [33], impulsivity [34], diagnosis subtypes [35] and so forth. At the same time the FAST allows to inquire in deep aspects of bipolar disorders impacting with the social burden of the disease as social function and stigma [36] and function related to specific care [37].
The FAST represents a step forward compared to the previously existing instruments, which were usually quite complex, had longer times of administration and did not discriminate amongst areas of functioning [1, 12, 26]. Therefore, the FAST could become particularly useful.
Similarly to the original version the Italian version of the FAST showed good psychometric properties such as high internal consistency, where the total items had a Cronbach's alpha above 0.9 and they remain higher than 0.9 also after the split half methodology. In addition, a strong concurrent validity, and a good discriminant validity were confirmed in the Italian version. The current study confirms also that the severity of symptoms was associated with higher scores of FAST and poorer functioning. In our sample a higher cut-off than that used in the Spanish version was more accurate for discriminate between euthymic and depressed or manic patients. However, this is probably not the most interesting propriety of the scale because it is not a screening tool useful to discriminate the clinical status of the patients. In the other hand, the clinical status is one of the factors determining social functioning but also other dimensions need to be take in consideration. These additional dimensions have probably links with the specific cultural background (see stigma [38], opportunities and so on [39]) and with the general well-being of a person (depending of a broader concept of health, [40]). Thus is not surprising that the level of social functioning associated with clinical impairment may vary amongst different cultures.
With regards to concurrent validity, the FAST confirmed, as in the first validation study, a strong negative correlation with the GAF scale, which is the main instrument for assessing the current level of functioning [19, 41]. The GAF gives ratings from 0 to 100, which specifies anchors for quantification of overall psychosocial functioning adjustment, where the higher scores of GAF represent better psychosocial functioning [19, 42, 43]. In opposition to the GAF, the FAST assesses specific domains of functioning and also identifies the level of impairment in each area; higher scores represent higher disability thus a negative correlation was actually expected. The data of the present study indicate that each one of these domains had shown to be negative correlated to the overall GAF score, this is an indirect measure of the broad validity of the GAF but also an indication of the need of a more detailed measure of the specific functioning in each area.
The test-retest reliability add probably some new data to the first validation study. The study indicate that not only the FAST reach a good correlation in the two measures (t0 and t1) but also the sub measures of each FAST areas show a strict correlation in the scores at the test re-test. More in details the test re-test reliability shown for each item a K agreement from sufficient to excellent. Sufficient (K from 0.40 to 0.60) was shown for items 14 (K=0.49); 10 (0.55); 2 (0.57); 13 and 15 (0.60); Good (K from 0.60 to 0.80) for items 3; 24 (K=0.61); (K=0.62); 4 (0.64); 12 and 21 (0.69); 23 (0.68); 11 (0.72); 8 and 19 (0.73); 9 and 18 (0.77); Excellent (K from 0.80 to 1) for items 17 (K=0.82); 6 (0.83); 22 (0.84); 1 (0.88); 7 and 20 (0.89); 16 (0.92) and 5 (0.94).
CONCLUSION
The use of functioning outcomes is increasingly being advocated in multinational clinical trials and comparative studies. Hence, there is a need for pragmatic, valid, reliable and user-friendly tools available in as many languages as possible [32]. The Italian validation of the Functioning Assessment Short Test (FAST), which was explicitly designed to gauge functioning dimensions empirically linked to bipolar disorder, has shown sufficient validity and reliability, which enables its use in Italian studies and in international clinical trials and comparative studies.
COMPETING INTERESTS
The author(s) declare that they have no competing interests.
DISCLOSURE OF INTEREST
Dr. Francesc Colom has served as advisory or speaker for the following companies: Adamed, Astra Zeneca, Bristol-Myers, Eli-Lilly, Glaxo-Smith-Kline, Lundbeck, MSD-Merck, Otsuka, Pfizer Inc, Sanofi-Aventis, Shire and Tecnifar.
He has received copyright fees from: Cambridge University Press, Solal Ed., Ars Médica, Giovani Fioriti Ed., Medipage, La Esfera de Los Libros, Morales i Torres Ed, Panamericana, Mayo Ed. & Columna.
Prof Mauro Giovanni Carta served as advisory speaker for the following public institutions: EMA, Social and Economic European Committee; Regione Autonoma della Sardegna.
He has received copyright fees from OS Edizioni Speciali, Firenze.
FUNDING SOURCES
Francesc Colom received support and funding of the Spanish Ministry of Health, Instituto de Salud Carlos III, CIBER-SAM. Dr Colom is also funded by the Spanish Ministry of Economy and Competitivity, Instituto Carlos III, through a ‘‘Miguel Servet’’ postdoctoral contract (CP08/00140) and a FIS (PS09/01044).
Prof Mauro Giovanni Carta received support and funding of the Regione Autonoma della Sardegna, Agenzia Italiana del Farmaco, Executive Agency of Health and Conusmers of European Union (EAHC), European Social Found, Astra Zeneca.
ACKNOWLEDGEMENT
Declared none.
CONFLICT OF INTEREST
The authors confirm that this article content has no conflicts of interest.
APPENDIX
FAST ITALIAN VERSION
Functioning Assessment Short Test (Fast)
Fino a che punto il paziente sta vivendo difficoltà nei seguenti aspetti?
Interrogare il paziente sulle difficoltà nelle varie aree di funzionamento e assegnare un valore secondo la seguente scala: (0): nessuna difficoltà, (1): difficoltà lieve, (2): difficoltà moderata, (3): difficoltà grave.
AUTONOMIA | |
1. Gestire la propria casa | (0) (1) (2) (3) |
2. Vivere da solo | (0) (1) (2) (3) |
3. Comprare ciò di cui ha bisogno | (0) (1) (2) (3) |
4. Prendersi cura di sè (aspetto fisico, igiene) | (0) (1) (2) (3) |
|
|
FUNZIONAMENTO LAVORATIVO | |
5. Mantenere un lavoro retribuito | (0) (1) (2) (3) |
6. Svolgere compiti alla velocità richiesta | (0) (1) (2) (3) |
7. Lavorare nel campo per il quale ha studiato | (0) (1) (2) (3) |
8. Guadagnare in maniera congrua al proprio lavoro | (0) (1) (2) (3) |
9. Garantire il rendimento previsto per il proprio lavoro | (0) (1) (2) (3) |
|
|
FUNZIONAMENTO COGNITIVO | |
10. Capacità di concentrarsi su un libro o un film | (0) (1) (2) (3) |
11. Capacità di svolgere calcoli mentali | (0) (1) (2) (3) |
12. Capacità di risolvere adeguatamente un problema | (0) (1) (2) (3) |
13. Capacità di ricordare il nome di persone conosciute da poco | (0) (1) (2) (3) |
14. Capacità di apprendere nuove informazioni | |
|
|
ASPETTI FINANZIARI | |
15. Gestire il proprio denaro | (0) (1) (2) (3) |
16. Spendere il denaro in maniera equilibrata | (0) (1) (2) (3) |
|
|
RELAZIONI INTERPERSONALI | |
17. Mantenere un’amicizia | (0) (1) (2) (3) |
18. Partecipare ad attività sociali | (0) (1) (2) (3) |
19. Mantenere una buona relazione con persone vicine | (0) (1) (2) (3) |
20. Vivere insieme alla propria famiglia | (0) (1) (2) (3) |
21. Avere rapporti sessuali soddisfacenti | (0) (1) (2) (3) |
22. Essere in grado di difendere i propri interessi | (0) (1) (2) (3) |
|
|
TEMPO LIBERO | |
23. Praticare sport o svolgere esercizio fisico | (0) (1) (2) (3) |
24. Avere un passatempo o interessi personali | (0) (1) (2) (3) |