Response Disposition Dashboard
Live quality triage results for the Technology Adoption Barriers Survey (2026 v2). Data is updated automatically by the disposition pipeline.
Overview
Disposition Breakdown
Failed 2+ attention checks or speed + attention compound failure.
All quality checks passed. Approved on Prolific.
Missed 1 of 3 attention checks at normal speed. Manual review.
Below 9-minute doctoral SME benchmark but passed all attention checks.
Near-identical responses in one or more question blocks (SD < 0.5).
Completed in under 5 minutes but passed all attention checks.
reCAPTCHA score below 0.5, indicating potential bot activity.
Action Status
| Action | Count |
|---|---|
| Approved on Prolific | 56 |
| Rejected on Prolific | 1 |
| Messaged (awaiting reply) | 5 |
| Pending Review | 73 |
Attention Check (IRI) Pass Rates
Three instructed-response items are embedded in the survey to detect inattentive responding. Each requires selecting a specific answer.
Barrier IRI
Block: 19 items | Expected: “Major Barrier”
Readiness IRI
Block: 18 items | Expected: “Low Readiness/Capability”
Maturity IRI
Block: 9 items | Expected: “Level 2: Developing/Repeatable”
Disposition Waterfall
Each response is evaluated through this waterfall — the first matching step determines the disposition:
| Step | Disposition | Criteria |
|---|---|---|
| 0 | INCOMPLETE | Survey not finished |
| 1 | AUTO-EXCLUDE | IRI failures ≥ 2, or speed (<5 min) + any IRI failure |
| 2 | FLAG-SPEED | <5 min but all 3 IRIs passed |
| 3 | FLAG-SINGLE-IRI | 1 IRI failure at normal speed |
| 4 | FLAG-SMEAL | 5-9 min (below Smeal eDBA benchmark) |
| 5 | FLAG-RECAPTCHA | reCAPTCHA score < 0.5 |
| 6 | FLAG-STRAIGHTLINING | Qualtrics: same answer for every item in a block |
| 7 | FLAG-PARTIAL-STRAIGHTLINING | Within-person SD < 0.5 in any block |
| 8 | CLEAN | All checks passed |
