Table 2 Cognitive interviewing applied to the development of a pragmatic measure and administration protocol: The MBC2OTP case example (K23DA050729)

1. Introduce partners to the purpose of the cognitive interview

1. Partners are shown the MBC2OTP pragmatic measure via videoconference screen share

2. An interviewer reads a welcome script which includes an overview of interview goals, a definition of the measurement goals, technical procedures (e.g., audio-recording, transcription, etc.)

2. Ask partners a question and record the response

1. Partners are asked to administer the measure as they would in a counseling session with a patient

2. Partners are asked to consider how the assessment data collected could inform their treatment approach

3. Use a series of verbal probes corresponding to the 4-stage cognitive interviewing model: (1) Comprehension

(2) Memory Retrieval

(3) Judgement

(4) Response

Scripted probes are used to assess question clarity, relevancy, and alignment with program goals

Interviewers note if partners need any part of the question repeated, if partners have difficulty using any of the response options provided or ask for clarification prior to providing their response. Partners are also provided the opportunity to give general feedback about each question including why they answered the way they did, how easy it was to provide an answer, and whether the language/content was appropriate

Repeat steps 2–3 for each item

 4. Collect partner feedback on measure administration protocol

Open-ended questions are used to examine measure administration procedures:

1. [Question content] How well do you feel the questions captured the important things to ask to assess treatment progress?

2. [Measure format] What are your thoughts on measure length? How long would you prefer that the measure take?

3. [Measure administration] How frequently should patients complete a measure like this?

4. [Measure fit for group counseling] Should this measure be completed prior to or during a group counseling session?

5. [Current treatment workflow] How easy would it be to make a measurement-based care tool available for use in your electronic health record?