Key Findings
All effect sizes, cross-tabulations, t-tests, and ANOVA are computed independently for each of the four primary result groups. This ensures that any finding can be validated against the researcher’s chosen dataset.
Effect Sizes (Cohen’s d)
Cohen’s d measures the standardized difference between group means. Values of |d| < 0.2 are negligible, 0.2–0.5 small, 0.5–0.8 medium, and > 0.8 large. Each comparison is computed separately for each result group.
Conservative Clean (N=80)
Technical (CIO/CTO) vs Non-Technical — n=15 vs n=52
| Construct | Tech Mean | Non-Tech Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.7222 | 2.8807 | -0.23 | small |
| readiness | 3.3250 | 3.0075 | +0.54 | medium |
| maturity | 3.1083 | 3.0003 | +0.15 | negligible |
Large Org (5000+) vs Small/Medium — n=17 vs n=63
| Construct | Large Mean | S/M Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 3.0919 | 2.7515 | +0.55 | medium |
| readiness | 3.0222 | 3.0611 | -0.07 | negligible |
Flexible Clean (N=127)
Technical (CIO/CTO) vs Non-Technical — n=29 vs n=79
| Construct | Tech Mean | Non-Tech Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.6475 | 2.8762 | -0.31 | small |
| readiness | 3.4173 | 3.0380 | +0.57 | medium |
| maturity | 3.2716 | 3.0334 | +0.30 | small |
Large Org (5000+) vs Small/Medium — n=24 vs n=103
| Construct | Large Mean | S/M Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 3.0883 | 2.7508 | +0.48 | small |
| readiness | 2.9544 | 3.1300 | -0.27 | small |
Prolific Accepted (N=231)
Technical (CIO/CTO) vs Non-Technical — n=51 vs n=133
| Construct | Tech Mean | Non-Tech Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.7097 | 2.7974 | -0.12 | negligible |
| readiness | 3.4402 | 3.0718 | +0.56 | medium |
| maturity | 3.3463 | 3.0949 | +0.31 | small |
Large Org (5000+) vs Small/Medium — n=53 vs n=178
| Construct | Large Mean | S/M Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.9026 | 2.7422 | +0.22 | small |
| readiness | 3.1666 | 3.1321 | +0.05 | negligible |
All V2 Finished (N=368)
Technical (CIO/CTO) vs Non-Technical — n=91 vs n=206
| Construct | Tech Mean | Non-Tech Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.6633 | 2.7598 | -0.12 | negligible |
| readiness | 3.4678 | 3.2151 | +0.35 | small |
| maturity | 3.4084 | 3.2395 | +0.21 | small |
Large Org (5000+) vs Small/Medium — n=84 vs n=284
| Construct | Large Mean | S/M Mean | Cohen’s d | Size |
|---|---|---|---|---|
| barriers | 2.8781 | 2.6993 | +0.23 | small |
| readiness | 3.2641 | 3.2450 | +0.03 | negligible |
Cross-Tabulations
Cross-tabulations show construct means broken down by respondent subgroups (role, org size). These are computed for each result group to check whether group-level patterns hold across data cleaning levels.
Conservative Clean (N=80)
By Role
| Group | n | B | R | M |
|---|---|---|---|---|
| Technical (CIO/CTO) | 15 | 2.72 | 3.33 | 3.11 |
| Non-Technical | 52 | 2.88 | 3.01 | 3.00 |
| Other | 13 | 2.71 | 2.92 | 3.11 |
By Org Size
| Group | n | B | R | M |
|---|---|---|---|---|
| Small (<500) | 38 | 2.80 | 3.06 | 2.98 |
| Medium (500-4999) | 25 | 2.68 | 3.06 | 2.95 |
| Large (5000+) | 17 | 3.09 | 3.02 | 3.30 |
Flexible Clean (N=127)
By Role
| Group | n | B | R | M |
|---|---|---|---|---|
| Technical (CIO/CTO) | 29 | 2.65 | 3.42 | 3.27 |
| Non-Technical | 79 | 2.88 | 3.04 | 3.03 |
| Other | 19 | 2.81 | 2.85 | 2.89 |
By Org Size
| Group | n | B | R | M |
|---|---|---|---|---|
| Small (<500) | 57 | 2.75 | 3.12 | 2.98 |
| Medium (500-4999) | 46 | 2.76 | 3.15 | 3.14 |
| Large (5000+) | 24 | 3.09 | 2.95 | 3.13 |
Prolific Accepted (N=231)
By Role
| Group | n | B | R | M |
|---|---|---|---|---|
| Technical (CIO/CTO) | 51 | 2.71 | 3.44 | 3.35 |
| Non-Technical | 133 | 2.80 | 3.07 | 3.09 |
| Other | 45 | 2.79 | 2.96 | 3.08 |
By Org Size
| Group | n | B | R | M |
|---|---|---|---|---|
| Small (<500) | 97 | 2.74 | 3.05 | 3.00 |
| Medium (500-4999) | 81 | 2.75 | 3.23 | 3.24 |
| Large (5000+) | 53 | 2.90 | 3.17 | 3.33 |
All V2 Finished (N=368)
By Role
| Group | n | B | R | M |
|---|---|---|---|---|
| Technical (CIO/CTO) | 91 | 2.66 | 3.47 | 3.41 |
| Non-Technical | 206 | 2.76 | 3.22 | 3.24 |
| Other | 66 | 2.78 | 3.02 | 3.12 |
By Org Size
| Group | n | B | R | M |
|---|---|---|---|---|
| Small (<500) | 154 | 2.66 | 3.17 | 3.14 |
| Medium (500-4999) | 130 | 2.74 | 3.33 | 3.35 |
| Large (5000+) | 84 | 2.88 | 3.26 | 3.37 |
Inferential Statistics
Welch’s t-tests compare two groups (unequal variance assumed). One-way ANOVA tests whether means differ across three or more groups. All tests are two-tailed with α = 0.05. Significant results (p < 0.05) are highlighted.
Conservative Clean
Welch’s t-test: Technical vs Non-Technical(ntech=15, nnon-tech=52)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | -0.758 | 21.1 | <.001 | ✱ |
| readiness | 1.908 | 23.8 | <.001 | ✱ |
| maturity | 0.474 | 20.3 | <.001 | ✱ |
Welch’s t-test: Large vs Small/Medium Org(nlarge=17, nsm/med=63)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | 2.163 | 28.3 | <.001 | ✱ |
| readiness | -0.234 | 24.0 | <.001 | ✱ |
| maturity | 1.572 | 22.4 | <.001 | ✱ |
One-way ANOVA: by Role(Technical (CIO/CTO), Non-Technical, Other)
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 0.594 | 2, 77 | 0.555 | |
| readiness | 2.212 | 2, 77 | 0.116 | |
| maturity | 0.204 | 2, 77 | 0.816 |
One-way ANOVA: by Organization Size(Small (<500), Medium (500-4999), Large (5000+))
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 2.307 | 2, 77 | 0.106 | |
| readiness | 0.031 | 2, 77 | 0.970 | |
| maturity | 1.512 | 2, 77 | 0.227 |
Flexible Clean
Welch’s t-test: Technical vs Non-Technical(ntech=29, nnon-tech=79)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | -1.450 | 52.6 | <.001 | ✱ |
| readiness | 2.883 | 59.6 | <.001 | ✱ |
| maturity | 1.431 | 55.3 | <.001 | ✱ |
Welch’s t-test: Large vs Small/Medium Org(nlarge=24, nsm/med=103)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | 2.155 | 35.5 | <.001 | ✱ |
| readiness | -1.128 | 32.9 | <.001 | ✱ |
| maturity | 0.389 | 31.4 | <.001 | ✱ |
One-way ANOVA: by Role(Technical (CIO/CTO), Non-Technical, Other)
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 1.078 | 2, 124 | 0.343 | |
| readiness | 5.436 | 2, 124 | 0.005 | ✱ |
| maturity | 1.520 | 2, 124 | 0.223 |
One-way ANOVA: by Organization Size(Small (<500), Medium (500-4999), Large (5000+))
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 2.194 | 2, 124 | 0.116 | |
| readiness | 0.721 | 2, 124 | 0.488 | |
| maturity | 0.641 | 2, 124 | 0.528 |
Prolific Accepted
Welch’s t-test: Technical vs Non-Technical(ntech=51, nnon-tech=133)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | -0.711 | 88.8 | <.001 | ✱ |
| readiness | 3.493 | 95.8 | <.001 | ✱ |
| maturity | 1.903 | 90.5 | <.001 | ✱ |
Welch’s t-test: Large vs Small/Medium Org(nlarge=53, nsm/med=178)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | 1.452 | 86.8 | <.001 | ✱ |
| readiness | 0.302 | 76.7 | <.001 | ✱ |
| maturity | 1.729 | 79.6 | <.001 | ✱ |
One-way ANOVA: by Role(Technical (CIO/CTO), Non-Technical, Other)
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 0.285 | 2, 226 | 0.752 | |
| readiness | 7.770 | 2, 226 | <.001 | ✱ |
| maturity | 2.043 | 2, 226 | 0.132 |
One-way ANOVA: by Organization Size(Small (<500), Medium (500-4999), Large (5000+))
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 1.035 | 2, 228 | 0.357 | |
| readiness | 1.571 | 2, 228 | 0.210 | |
| maturity | 3.679 | 2, 228 | 0.027 | ✱ |
All V2 Finished
Welch’s t-test: Technical vs Non-Technical(ntech=91, nnon-tech=206)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | -0.950 | 170.6 | <.001 | ✱ |
| readiness | 2.837 | 174.9 | <.001 | ✱ |
| maturity | 1.700 | 179.2 | <.001 | ✱ |
Welch’s t-test: Large vs Small/Medium Org(nlarge=84, nsm/med=284)
| Construct | t | df | p | Sig. |
|---|---|---|---|---|
| barriers | 1.880 | 136.7 | <.001 | ✱ |
| readiness | 0.209 | 130.7 | <.001 | ✱ |
| maturity | 1.261 | 129.9 | <.001 | ✱ |
One-way ANOVA: by Role(Technical (CIO/CTO), Non-Technical, Other)
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 0.594 | 2, 360 | 0.553 | |
| readiness | 8.168 | 2, 359 | <.001 | ✱ |
| maturity | 2.656 | 2, 359 | 0.072 |
One-way ANOVA: by Organization Size(Small (<500), Medium (500-4999), Large (5000+))
| Construct | F | df | p | Sig. |
|---|---|---|---|---|
| barriers | 2.131 | 2, 365 | 0.120 | |
| readiness | 1.800 | 2, 364 | 0.167 | |
| maturity | 3.424 | 2, 364 | 0.034 | ✱ |
Forthcoming Analyses
The following additional analyses are planned for future releases:
Regression ModelsFactor Analysis
Related
- Descriptive Statistics — means, SDs, and correlations per result group
- Sample & Demographics — demographic breakdowns per result group
- Sensitivity Analysis — all metrics and deltas across datasets
- Dataset Comparison — side-by-side statistics across all four result groups
- ← Back to Results Overview