With the increased use of computer-based tests in clinical and research settings, assessing retest reliability and reliable change of NIH Toolbox-Cognition Battery (NIHTB-CB) and Cogstate Brief Battery (Cogstate) is essential. Previous studies used mostly White samples, but Black/African Americans (B/AAs) must be included in this research to ensure reliability.

Participants were B/AA consensus-confirmed healthy controls (HCs) (n = 49) or mild cognitive impairment (MCI) (n = 34) adults 60–85 years that completed NIHTB-CB and Cogstate for laptop at two timepoints within 4 months. Intraclass correlations, the Bland-Altman method, t-tests, and the Pearson correlation coefficient were used. Cut scores indicating reliable change provided.

NIHTB-CB composite reliability ranged from .81 to .93 (95% CIs [.37–.96]). The Fluid Composite demonstrated a significant difference between timepoints and was less consistent than the Crystallized Composite. Subtests were less consistent for MCIs (ICCs = .01–.89, CIs [−1.00–.95]) than for HCs (ICCs = .69–.93, CIs [.46–.92]). A moderate correlation was found for MCIs between timepoints and performance on the Total Composite (r = -.40, p = .03), Fluid Composite (r = -.38, p = .03), and Pattern Comparison Processing Speed (r = -.47, p = .006).

On Cogstate, HCs had lower reliability (ICCs = .47–.76, CIs [.05–.86]) than MCIs (ICCs = .65–.89, CIs [.29–.95]). Identification reaction time significantly improved between testing timepoints across samples.

The NIHTB-CB and Cogstate for laptop show promise for use in research with B/AAs and were reasonably stable up to 4 months. Still, differences were found between those with MCI and HCs. It is recommended that race and cognitive status be considered when using these measures.

Fibre-optic laryngoscopy is still widely used in daily clinical practice; however, high-definition laryngoscopy using narrow band imaging could be more reliable in characterising pharyngeal and laryngeal lesions.

Endoscopic videos were assessed in a tertiary referral hospital by 12 observers with different levels of clinical experience. Thirty pairs of high-definition laryngoscopy with narrow band imaging and fibre-optic laryngoscopy videos were judged twice, with an interval of two to four weeks, in a random order. Inter- and intra-observer reliability, sensitivity and specificity were calculated in terms of detecting a malignant lesion and a specific histological entity, for beginners, trained observers and experts.

Using high-definition laryngoscopy with narrow band imaging, inter-observer reliability for detecting malignant lesions increased from moderate to substantial in trained observers and experts (high-definition laryngoscopy with narrow band imaging κ = 0.66 and κ = 0.77 vs fibre-optic laryngoscopy κ = 0.51 and κ = 0.56, for trained observers and experts respectively) and sensitivity increased by 16 per cent.

Inter-observer reliability increased with the level of clinical experience, especially when using high-definition laryngoscopy with narrow band imaging.

To evaluate the methodological and reporting characteristics of search methods of systematic reviews (SRs) using the Preferred Reporting of Systematic Reviews and Meta-Analyses (PRISMA) checklist and the Risk Of Bias In Systematic reviews (ROBIS) tool.

A sample of 505 SRs published in 2016 was taken from KSR Evidence, a database of SRs, and analyzed to assess compliance with Information sources and Search of the PRISMA checklist. Domain 2 (D2) (Identification and Selection of Studies) of the ROBIS tool was used to judge the risk of bias in search methods.

Regarding Information sources and Search of PRISMA, twenty percent of SRs which claimed to be PRISMA-compliant in their methods, were compliant; twenty-four percent of SRs published in journals that require PRISMA reporting were compliant; nineteen percent in total were found to be compliant. Twenty-eight percent of SRs were judged to be at a low risk of bias in D2 and so searched widely with an effective strategy and, finally, ten percent were both compliant with the reporting of Information sources and with Search of PRISMA and were judged to be at a low risk of bias in D2.

Ninety percent of SRs are failing to report search methods adequately and to conduct comprehensive searches using a wide range of resources. Editors of journals and peer reviewers need to ensure that they understand the requirements of PRISMA and that compliance is adhered to. Additionally, the comprehensiveness of search methods for SRs needs to be given more critical consideration.

There is accumulating evidence that the error-related negativity (ERN), an event-related potential elicited after erroneous actions, is altered in different psychiatric disorders and may help to guide treatment options. Thus, the ERN is a promising candidate as a psychiatric biomarker. Basic methodological requirements for a biomarker are that their measurements are standardised and reliable. The aim of the present study was to establish ERN acquisition in a reliable, time-efficient and patient-friendly way for use in clinical practice.

Healthy subjects performed a speeded Eriksen Flanker Task that increases the number of errors. In a test–retest design (N = 14) with two sessions separated by 28 days we assessed the reliability of the ERN. To ensure external validity, we aimed to replicate previously reported correlation patterns of ERN amplitude with (A) number of errors and (B) negative affect. In order to optimise the clinical use of the task, we determined to which extent the task can be shortened while keeping reliability >0.80.

We found excellent reliability of the ERN (intraclass correlation coefficients = 0.806–0.947) and replicated ERN correlation patterns. The task can be halved to a patient-friendly length of 200 trials (recorded in 8 min) keeping reliability >0.80.

The modified task provides reliable and efficient recording of the ERN, facilitating its use as a psychiatric biomarker.

Studies demonstrate the significance of intra- and inter-observer variability when measuring cerebellopontine angle tumours on magnetic resonance imaging, with measured differences as high as 2 mm.

To determine intra- and inter-observer measurement variability of cerebellopontine angle tumours in a specialised institution.

The magnetic resonance imaging maximal diameter of 12 randomly selected cerebellopontine angle tumours were independently measured by 4 neuroradiologists at a tertiary referral centre using a standard definition for maximal tumour diameter. Average deviation and intraclass correlation were subsequently calculated.

Inter-observer difference averaged 0.33 ± 0.04 mm (range, 0.0–0.8 mm). Intra-observer measurements were more consistent than inter-observer measurements, with differences averaging 0.17 mm (95 per cent confidence interval = 0.27–0.06, p = 0.002). Inter-observer reliability was 0.99 (95 per cent confidence interval = 0.97–0.99), suggesting high reliability between the readings.

The use of a standard definition for maximal tumour volume provided high reliability amongst radiologists' readings. To avoid oversizing tumours, it is recommended that conservative monitoring be conducted by the same institution with thin slice magnetic resonance imaging scans.

This study aimed to compare two sampling methods for nasal nitric oxide in healthy individuals and allergic rhinitis patients, and to examine the within-subject reliability of nasal nitric oxide measurement.

The study included 23 allergic rhinitis patients without concomitant asthma and 10 healthy individuals. For all participants, nitric oxide levels were measured non-invasively from the lungs through the mouth (i.e. the oral fractional exhaled nitric oxide) and the nose. Nasal nitric oxide was measured by two different methods: (1) nasal aspiration via one nostril during breath holding and (2) single-breath quiet exhalation against resistance through a tight facemask (i.e. the nasal fractional exhaled nitric oxide).

Compared with healthy participants, allergic rhinitis patients had significantly higher average oral and nasal nitric oxide levels. All methods of nitric oxide measurement had excellent reliability.

Nasal nitric oxide measurement is a useful and reliable clinical tool for diagnosing allergic rhinitis in patients without asthma in an out-patient setting.

To assess the inter-method reliability of the Ovarian Cancer in Alberta (OVAL) survey developed to estimate adult vitamin D exposure from sun and diet for every tenth year, against the longer Geraldton Skin Cancer Prevention Survey (the assumed ‘gold standard’). We also estimated total vitamin D exposure using the OVAL survey.

A randomized crossover design to assess the inter-method reliability of sun exposure (OVAL v. Geraldton survey), using intra-class correlation and estimated total vitamin D exposure from sun and diet.

Calgary, Alberta, Canada.

Randomly selected women (n 90) aged 40–79 years.

The average lifetime sun exposure of 13 913 h (average 411 h/year) from the Geraldton survey was not significantly different from the 13 034 h (average 385 h/year) from the OVAL survey for periods with sufficient UV radiation to stimulate vitamin D production. The intra-class correlation coefficient for average lifetime sun exposure was 0·77 (95 % CI 0·69, 0·86); the annual average was 0·60 (95 % CI 0·47, 0·74). Estimated vitamin D from diet and supplements increased with age.

Our OVAL survey reliably estimated adult sun exposure relative to the Geraldton survey, suggesting that assessing sun exposure every tenth year is a reliable and efficient method for estimating sun contributions to lifetime vitamin D exposure.

Methods of perceptual voice evaluation have yet to achieve satisfactory consistency; complete acceptance of a recognised clinical protocol is still some way off.

Three speech and language therapists rated the voices of 43 patients attending the problem asthma clinic of a teaching hospital, according to the grade-roughness-breathiness-asthenicity-strain (GRBAS) scale and other perceptual categories.

Use of the GRBAS scale achieved only a 64.7 per cent inter-rater reliability and a 69.6 per cent intra-rater reliability for the grade component. One rater achieved a higher degree of consistency. Improved concordance on the GRBAS scale was observed for subjects with laryngeal abnormalities. Raters failed to reach any useful level of agreement in the other categories employed, except for perceived gender.

These results should sound a note of caution regarding routine adoption of the GRBAS scale for characterising voice quality for clinical purposes. The importance of training and the use of perceptual anchors for reliable perceptual rating need to be further investigated.

To compare intake estimates, validity and reliability of two summary questions to measure fish consumption with information from a detailed semi-quantitative food-frequency questionnaire (FFQ) on fish consumption.

Population-based, cross-sectional study. Participants completed an FFQ and provided blood samples for erythrocyte membrane eicosapentaenoic acid (EPA) analysis. Aggregate measures of consumption of fresh/frozen/canned fish (fresh fish) and smoked/salted/dried fish (preserved fish) were generated from the FFQ and were compared with responses to the summary questions regarding intakes of similar items. Both methods were tested for validity, using correlation and linear regression techniques with EPA, and retest reliability.

Perth metropolitan area, Western Australia.

One hundred and nine healthy volunteers of both sexes, aged 21–75 years.

The summary fresh fish measure underestimated frequency and grams per week given by the aggregate question by about 50%, while estimates from the summary preserved fish measure were approximately three times that of the aggregate measure. Multiple linear regression analysis suggested that the aggregates accounted for more of the variation in EPA levels, but the difference was minimal. Intra-class correlations confirmed that both methods were reliable.

Our study indicates that extensive questioning results in different absolute intakes of fish compared with brief questioning, but does not add any information if ranking individuals according to overall consumption of fish.

Body sprays and perfumes are commonly worn by patients attending ENT out-patients clinics. Their effect on performance in olfactory testing is unknown. The aim of this study was to determine whether olfactory thresholds are altered by the presence of such fragrances.

One hundred and sixty healthy volunteers, aged 18 to 65 years, underwent olfactory thresholds testing. Each was then exposed to one of four strong perfumes, applied in a facemask for two minutes, and the thresholds were retested.

All olfactory thresholds worsened after being exposed to the strong perfumes of LynxTM and ImpulseTM body sprays, with the strongest effect being on olfactory detection of phenylethyl alcohol (p<0.001).

Strong perfumes can have a negative effect on olfactory thresholds.

Patients attending olfactory threshold testing need to be advised not to wear body sprays or perfumes.