PickMyTest

Mixed ANOVA

Mixed ANOVA combines between-subjects and within-subjects factors in one design, testing main effects and their interaction.

Mixed ANOVA#

The Mixed ANOVA is the go-to method when your design includes both a between-subjects factor (e.g., group membership) and a within-subjects factor (e.g., repeated measurements over time). Also known as a split-plot design, it gives you three key results: the main effect of each factor and their interaction.

When to Use#

  • You have two or more groups (between-subjects factor) measured at multiple time points (within-subjects factor)
  • Your study uses a classic pre-post design with a control group or a longitudinal comparison across groups
  • You want to know not just whether groups differ or scores change over time, but whether the pattern of change differs between groups (interaction)
  • Your dependent variable is continuous (interval or ratio scale)
  • You have complete data β€” with missing values, linear mixed models (LMM) are a better choice

Assumptions#

  • Normality in each cell (Group x Time point)
  • Sphericity of the within-subjects factor (Mauchly's test)
  • Homogeneity of variances across groups (Levene's test)
  • Homogeneity of covariance matrices (Box's M test)

Tip: If sphericity is violated, correct the degrees of freedom using Greenhouse-Geisser (conservative) or Huynh-Feldt (liberal). If Box's M is significant, interpret between-subjects effects with caution.

Formula#

The Mixed ANOVA computes three separate F-tests:

Main effect of the between-subjects factor:

Fbetween=MSbetweenMSerror(between)F_{\text{between}} = \frac{MS_{\text{between}}}{MS_{\text{error(between)}}}

Main effect of the within-subjects factor:

Fwithin=MSwithinMSerror(within)F_{\text{within}} = \frac{MS_{\text{within}}}{MS_{\text{error(within)}}}

Interaction:

Finteraction=MSinteractionMSerror(within)F_{\text{interaction}} = \frac{MS_{\text{interaction}}}{MS_{\text{error(within)}}}

Each F-value is compared against the F-distribution with degrees of freedom determined by the number of groups and measurement occasions.

Example#

Practical Example: Pain Treatment Over Time

A clinic compares a new drug to a placebo. 40 patients are randomly assigned to two groups (between-subjects factor: drug vs. placebo). Each patient rates their pain on a 0–10 scale at three time points: baseline, 2 weeks, and 4 weeks (within-subjects factor: time).

Results:

  • Main effect of group: F(1,38)=8.42F(1, 38) = 8.42, p=.006p = .006 β€” the drug group has overall lower pain scores
  • Main effect of time: F(2,76)=24.15F(2, 76) = 24.15, p<.001p < .001 β€” pain changes over time
  • Group x Time interaction: F(2,76)=11.87F(2, 76) = 11.87, p<.001p < .001 β€” the key finding: pain reduction is greater in the drug group than in the placebo group

Effect Size#

Partial eta-squared (Ξ·p2\eta_p^2) is reported for each effect:

Ξ·p2=SSeffectSSeffect+SSerror\eta_p^2 = \frac{SS_{\text{effect}}}{SS_{\text{effect}} + SS_{\text{error}}}

Ξ·p2\eta_p^2Interpretation
0.01small effect
0.06medium effect
0.14large effect

Tip: Report Ξ·p2\eta_p^2 separately for each of the three effects. The interaction effect is often the most interesting β€” it reveals whether groups develop differently over time.

Further Reading

  • Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th ed.). Sage.
  • Maxwell, S. E., Delaney, H. D., & Kelley, K. (2017). Designing Experiments and Analyzing Data (3rd ed.). Routledge.
  • Girden, E. R. (1992). ANOVA: Repeated Measures. Sage University Papers.