##
## Welch Two Sample t-test
##
## data: age by hormonal_contraception
## t = -10, df = 600, p-value <2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -6.0 -4.3
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 24 29
##
##
## Hedges's g
##
## g estimate: -0.61 (medium)
## 95 percent confidence interval:
## lower upper
## -0.74 -0.49
Religiosity
compare_by_group("religiosity", xsection)
##
## Welch Two Sample t-test
##
## data: religiosity by hormonal_contraception
## t = -0.09, df = 900, p-value = 0.9
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.15 0.13
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 2 2
##
##
## Hedges's g
##
## g estimate: -0.0053 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.13 0.12
Age at first time
compare_by_group("first_time", xsection)
##
## Welch Two Sample t-test
##
## data: first_time by hormonal_contraception
## t = 0.03, df = 800, p-value = 1
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.29 0.30
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 17 17
##
##
## Hedges's g
##
## g estimate: 0.0018 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.12 0.13
##
## Welch Two Sample t-test
##
## data: menarche by hormonal_contraception
## t = 0.7, df = 400, p-value = 0.5
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.17 0.35
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 13 13
##
##
## Hedges's g
##
## g estimate: 0.061 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.12 0.24
##
## Welch Two Sample t-test
##
## data: duration_relationship_total by hormonal_contraception
## t = -7, df = 600, p-value = 8e-13
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -2.9 -1.7
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.0 5.3
##
##
## Hedges's g
##
## g estimate: -0.38 (small)
## 95 percent confidence interval:
## lower upper
## -0.51 -0.26
##
## Welch Two Sample t-test
##
## data: cycle_length by hormonal_contraception
## t = -5, df = 800, p-value = 0.0000001
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -1.56 -0.72
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 28 29
##
##
## Hedges's g
##
## g estimate: -0.31 (small)
## 95 percent confidence interval:
## lower upper
## -0.43 -0.19
##
## Welch Two Sample t-test
##
## data: number_sexual_partner by hormonal_contraception
## t = -5, df = 600, p-value = 0.000004
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -5.1 -2.1
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 5.7 9.3
##
##
## Hedges's g
##
## g estimate: -0.24 (small)
## 95 percent confidence interval:
## lower upper
## -0.36 -0.12
Extraversion
compare_by_group("BFI_extra", xsection)
##
## Welch Two Sample t-test
##
## data: BFI_extra by hormonal_contraception
## t = -0.4, df = 900, p-value = 0.7
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.117 0.079
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.5 3.5
##
##
## Hedges's g
##
## g estimate: -0.024 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.147 0.099
Agreeableness
compare_by_group("BFI_agree", xsection)
##
## Welch Two Sample t-test
##
## data: BFI_agree by hormonal_contraception
## t = -0.2, df = 900, p-value = 0.8
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.080 0.065
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.6 3.6
##
##
## Hedges's g
##
## g estimate: -0.013 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.14 0.11
Neuroticism
compare_by_group("BFI_neuro", xsection)
##
## Welch Two Sample t-test
##
## data: BFI_neuro by hormonal_contraception
## t = 2, df = 900, p-value = 0.02
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## 0.019 0.206
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.1 3.0
##
##
## Hedges's g
##
## g estimate: 0.15 (negligible)
## 95 percent confidence interval:
## lower upper
## 0.022 0.268
Conscientiousness
compare_by_group("BFI_consc", xsection)
##
## Welch Two Sample t-test
##
## data: BFI_consc by hormonal_contraception
## t = 2, df = 900, p-value = 0.02
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## 0.016 0.185
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.6 3.5
##
##
## Hedges's g
##
## g estimate: 0.14 (negligible)
## 95 percent confidence interval:
## lower upper
## 0.02 0.27
Openness
compare_by_group("BFI_open", xsection)
##
## Welch Two Sample t-test
##
## data: BFI_open by hormonal_contraception
## t = -5, df = 900, p-value = 0.0000004
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -0.28 -0.12
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 3.6 3.8
##
##
## Hedges's g
##
## g estimate: -0.32 (small)
## 95 percent confidence interval:
## lower upper
## -0.45 -0.20
Relationship satisfaction
compare_by_group("ZIP", xsection)
##
## Welch Two Sample t-test
##
## data: ZIP by hormonal_contraception
## t = 3, df = 900, p-value = 0.002
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## 0.049 0.227
## sample estimates:
## mean in group hormonal contraceptive user mean in group naturally cycling
## 4.2 4.0
##
##
## Hedges's g
##
## g estimate: 0.18 (negligible)
## 95 percent confidence interval:
## lower upper
## 0.061 0.307
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.0021235 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 12 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.5 Generalizability of a single time point across all items (Random time effects)
RkR = 0.98 Generalizability of average time points across all items (Random time effects)
Rc = 0.76 Generalizability of change (fixed time points, fixed items)
RkRn = 0.98 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.6 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.28 0.12
Time 0.00 0.00
Items 0.21 0.09
ID x time 0.24 0.10
ID x items 0.40 0.17
time x items 0.28 0.12
Residual 0.90 0.39
Total 2.31 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.32 0.157
id(time) 0.19 0.093
residual 1.51 0.750
total 2.01 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.0145761 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 5 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.55 Generalizability of a single time point across all items (Random time effects)
RkR = 0.98 Generalizability of average time points across all items (Random time effects)
Rc = 0.62 Generalizability of change (fixed time points, fixed items)
RkRn = 0.98 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.36 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.37 0.17
Time 0.00 0.00
Items 0.14 0.07
ID x time 0.22 0.11
ID x items 0.32 0.15
time x items 0.37 0.17
Residual 0.68 0.32
Total 2.09 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.43 0.253
id(time) 0.13 0.076
residual 1.14 0.670
total 1.70 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.00281509 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.46 Generalizability of a single time point across all items (Random time effects)
RkR = 0.97 Generalizability of average time points across all items (Random time effects)
Rc = 0.49 Generalizability of change (fixed time points, fixed items)
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.36 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.21 0.19
Time 0.00 0.00
Items 0.01 0.01
ID x time 0.14 0.12
ID x items 0.11 0.10
time x items 0.21 0.19
Residual 0.44 0.39
Total 1.10 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.24 0.27
id(time) 0.10 0.11
residual 0.54 0.61
total 0.89 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.0619795 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 2 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.44 Generalizability of a single time point across all items (Random time effects)
RkR = 0.97 Generalizability of average time points across all items (Random time effects)
Rc = 0.54 Generalizability of change (fixed time points, fixed items)
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.24 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.58 0.02
Time 0.00 0.00
Items 34.54 0.92
ID x time 0.54 0.01
ID x items 0.39 0.01
time x items 0.58 0.02
Residual 0.93 0.02
Total 37.56 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.78 0.305
id(time) 0.24 0.093
residual 1.54 0.602
total 2.55 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## singular fit
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 2 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.98 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.28 Generalizability of a single time point across all items (Random time effects)
RkR = 0.94 Generalizability of average time points across all items (Random time effects)
Rc = 0.75 Generalizability of change (fixed time points, fixed items)
RkRn = 0.94 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.61 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.46 0.13
Time 0.00 0.00
Items 0.05 0.01
ID x time 1.35 0.36
ID x items 0.46 0.12
time x items 0.46 0.13
Residual 0.92 0.25
Total 3.69 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.69 0.21
id(time) 1.10 0.34
residual 1.42 0.44
total 3.21 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.85 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.67 0.453
id(time) 0.69 0.466
residual 0.12 0.081
total 1.48 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.38 Generalizability of a single time point across all items (Random time effects)
RkR = 0.96 Generalizability of average time points across all items (Random time effects)
Rc = 0.82 Generalizability of change (fixed time points, fixed items)
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.75 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.68 0.21
Time 0.00 0.00
Items 0.09 0.03
ID x time 0.97 0.30
ID x items 0.17 0.05
time x items 0.68 0.21
Residual 0.62 0.19
Total 3.22 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.74 0.29
id(time) 0.89 0.35
residual 0.88 0.35
total 2.51 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.86 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.72 0.364
id(time) 1.08 0.545
residual 0.18 0.091
total 1.98 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.122512 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.39 Generalizability of a single time point across all items (Random time effects)
RkR = 0.96 Generalizability of average time points across all items (Random time effects)
Rc = 0.81 Generalizability of change (fixed time points, fixed items)
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.6 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.52 0.18
Time 0.00 0.00
Items 0.35 0.12
ID x time 0.72 0.26
ID x items 0.18 0.07
time x items 0.52 0.18
Residual 0.52 0.18
Total 2.82 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.58 0.26
id(time) 0.54 0.24
residual 1.09 0.49
total 2.21 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.500119 (tol = 0.002, component 1)
## singular fit
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 4 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.98 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.46 Generalizability of a single time point across all items (Random time effects)
RkR = 0.97 Generalizability of average time points across all items (Random time effects)
Rc = 0.43 Generalizability of change (fixed time points, fixed items)
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.30 0.07
Time 0.00 0.00
Items 1.04 0.24
ID x time 0.27 0.06
ID x items 0.97 0.22
time x items 0.30 0.07
Residual 1.44 0.33
Total 4.33 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.53 0.13
id(time) 0.00 0.00
residual 3.50 0.87
total 4.03 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.0101463 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 5 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.44 Generalizability of a single time point across all items (Random time effects)
RkR = 0.97 Generalizability of average time points across all items (Random time effects)
Rc = 0.68 Generalizability of change (fixed time points, fixed items)
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.17 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.41 0.10
Time 0.00 0.00
Items 1.08 0.26
ID x time 0.48 0.11
ID x items 0.67 0.16
time x items 0.41 0.10
Residual 1.13 0.27
Total 4.18 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.54 0.152
id(time) 0.12 0.033
residual 2.93 0.816
total 3.59 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.00404246 (tol = 0.002, component 1)
## singular fit
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.98 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.42 Generalizability of a single time point across all items (Random time effects)
RkR = 0.97 Generalizability of average time points across all items (Random time effects)
Rc = 0.29 Generalizability of change (fixed time points, fixed items)
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.12 0.06
Time 0.00 0.00
Items 0.45 0.21
ID x time 0.12 0.05
ID x items 0.49 0.23
time x items 0.12 0.06
Residual 0.85 0.40
Total 2.16 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.28 0.15
id(time) 0.00 0.00
residual 1.61 0.85
total 1.89 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## singular fit
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 1 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.68 Generalizability of a single time point across all items (Random time effects)
RkR = 0.99 Generalizability of average time points across all items (Random time effects)
Rc = 0.72 Generalizability of change (fixed time points, fixed items)
RkRn = 0.99 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.57 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 1.05 0.33
Time 0.00 0.00
Items 0.00 0.00
ID x time 0.38 0.12
ID x items 0.24 0.08
time x items 1.05 0.33
Residual 0.45 0.14
Total 3.17 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 1.13 0.53
id(time) 0.30 0.14
residual 0.69 0.33
total 2.12 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
## Warning: attributes are not identical across measure variables;
## they will be dropped
## Warning in checkConv(attr(opt, "derivs"), opt$par, ctrl = control$checkConv, : Model failed to converge with
## max|grad| = 0.0100517 (tol = 0.002, component 1)
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 3 items.
Alternative estimates of reliability based upon Generalizability theory
RkF = 0.99 Reliability of average of all ratings across all items and times (Fixed time effects)
R1R = 0.49 Generalizability of a single time point across all items (Random time effects)
RkR = 0.98 Generalizability of average time points across all items (Random time effects)
Rc = 0.65 Generalizability of change (fixed time points, fixed items)
RkRn = 0.98 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.53 Generalizability of within person variations averaged over items (time nested within people)
These reliabilities are derived from the components of variance estimated by lmer
variance Percent
ID 0.21 0.23
Time 0.00 0.00
Items 0.00 0.00
ID x time 0.16 0.17
ID x items 0.08 0.09
time x items 0.21 0.23
Residual 0.26 0.28
Total 0.94 1.00
The nested components of variance estimated from lmer are:
variance Percent
id 0.24 0.33
id(time) 0.13 0.18
residual 0.35 0.49
total 0.72 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.86 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.59 0.43
id(time) 0.67 0.49
residual 0.11 0.08
total 1.37 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.96 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.86 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.84 0.402
id(time) 1.07 0.512
residual 0.18 0.086
total 2.09 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.97 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.86 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.65 0.43
id(time) 0.73 0.49
residual 0.12 0.08
total 1.50 1.00
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
Multilevel Generalizability analysis
Call: multilevel.reliability(x = ., grp = "person", Time = "day_number",
items = "variable", aov = F, lmer = lmer, lme = lme, long = T,
values = "value")
The data had 1054 observations taken over 41 time intervals for 1 items.
Alternative estimates of reliability based upon Generalizability theory
RkRn = 0.72 Generalizability of between person differences averaged over time (time nested within people)
Rcn = 0.89 Generalizability of within person variations averaged over items (time nested within people)
The nested components of variance estimated from lme are:
Variance Percent
id 0.014 0.059
id(time) 0.200 0.837
residual 0.025 0.105
total 0.239 1.000
To see the ANOVA and alpha by subject, use the short = FALSE option.
To see the summaries of the ICCs by subject and time, use all=TRUE
To see specific objects select from the following list:
ANOVA s.lmer s.lme alpha summary.by.person summary.by.time ICC.by.person ICC.by.time lmer long Call
xtabs(~ hormonal_contraception + n_petting, data = sex_summary) %>% pander()
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
29
32
34
0
113
55
40
27
28
31
20
22
14
12
12
14
5
7
4
6
4
2
1
4
0
2
1
0
1
1
0
0
1
1
1
1
102
60
44
54
49
59
39
42
28
18
33
23
17
9
10
7
5
3
4
3
2
2
4
2
1
1
1
2
0
1
0
xtabs(~ hormonal_contraception + I(n_petting>0), data = sex_summary) %>% pander()
FALSE
TRUE
0
113
316
1
102
523
Measurement Reactivity
We test whether our analyses are robust to adjustments for measurement reactivity (operationalised as nonlinear time trends over number of days since the beginning of the diary, and over number of days filled out, ). The first approach do this is to test whether our main predictor, probability of being in the fertile window, varies systematically over days. This might happen, if women are more likely to begin our fill out the diary on (non)fertile days.
Because these analyses show small relationships to the predictor, that differ by hormonal contraception, we think it is worth testing if our results are robust to the inclusion of splines over days (since beginning/filled out).