In applied behavior analysis (ABA), selecting a measurement procedure for obtaining representative procedural integrity data involves careful consideration of the relevant dimensions of the intervention (e.g., accuracy and dosage) and environmental constraints. Procedural integrity refers to the extent to which an intervention is implemented as intended, and accurately measuring it ensures the validity of the intervention’s outcomes.
Here’s a breakdown of how to approach this selection:
1.Identify Key Dimensions for Measurement: Key dimensions of procedural integrity, such as accuracy and dosage, need to be defined based on the intervention. For example:
•Accuracy measures how closely each step of the procedure aligns with the planned intervention protocol.
•Dosage refers to the frequency, duration, or intensity with which the intervention is administered.
2.Choose Appropriate Measurement Methods:
•Direct Observation: This is one of the most common methods in ABA for assessing procedural integrity, where a trained observer records whether each step of the protocol is implemented accurately. This method provides real-time data but may be resource-intensive.
•Permanent Product Measurement: In some cases, evidence of intervention steps can be measured through products left after the intervention (e.g., completed worksheets). This approach can be less intrusive but may not capture all dimensions, like dosage or timing.
•Self-Report Checklists: Practitioners can use structured checklists to self-monitor procedural adherence, which is practical in settings with limited resources. However, it may be less reliable than direct observation due to potential biases.
3.Account for Environmental Constraints: Resource availability, setting logistics, and time constraints should inform the measurement procedure choice. For instance, in settings with limited personnel, self-report or permanent product recording might be more feasible than direct observation, even if it sacrifices some degree of accuracy.
4.Sample Representatively: Procedural integrity should be measured regularly but practically, considering the consistency of implementation. Sampling strategies might include continuous sampling for high-risk interventions or intermittent sampling for less intensive interventions.
Selecting the right measurement procedure helps ABA practitioners ensure that interventions are implemented as designed and that integrity data accurately reflects performance.
- For more detail, see: Wilder, D. A., Atwell, J., & Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during treatment with a three-step prompting procedure. Journal of Applied Behavior Analysis, 39(3), 369-373.
