-
Notifications
You must be signed in to change notification settings - Fork 3
/
README.Rmd
98 lines (76 loc) · 5.3 KB
/
README.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
---
output: github_document
---
<!-- README.md is generated from README.Rmd. Please edit that file -->
```{r, include = FALSE}
knitr::opts_chunk$set(
collapse = TRUE,
comment = "#>",
fig.path = "man/figures/README-",
out.width = "100%"
)
```
# measr <img src="man/figures/logo.png" align ="right" width="120"/>
<!-- badges: start -->
[](https://www.repostatus.org/#active)
[](https://lifecycle.r-lib.org/articles/stages.html)
[](https://cran.r-project.org/package=measr)
[](https://cran.r-project.org/package=measr)
[](https://doi.org/10.21105/joss.05742)</br>
[](https://github.com/wjakethompson/measr/actions/workflows/R-CMD-check.yaml)
[](https://app.codecov.io/gh/wjakethompson/measr)
[](https://app.netlify.com/sites/measr/deploys)</br>
[](https://keybase.io/wjakethompson)
<!-- badges: end -->
Diagnostic classification models (DCMs) are a class of psychometric models that estimate respondent abilities as a profile of proficiency on a pre-defined set of skills, or attributes.
Despite the utility of DCMs for providing fine-grained and actionable feedback with shorter assessments, they have are not widely used in applied settings, in part due to a lack of user-friendly software.
Using [R](https://www.r-project.org/) and [Stan](https://mc-stan.org/), measr (said: "measure") simplifies the process of estimating and evaluating DCMs.
Users can specify different DCM subtypes, define prior distributions, and estimate the model using the [rstan](https://mc-stan.org/rstan/) or [cmdstanr](https://mc-stan.org/cmdstanr/) interface to Stan.
You can then easily examine model parameters, calculate model fit metrics, compare competing models, and evaluate the reliability of the attributes.
## Installation
You can install the released version of measr from [CRAN](https://cran.r-project.org/) with:
```r
install.packages("measr")
```
To install the development version of measr from [GitHub](https://github.com/wjakethompson/measr) use:
```r
# install.packages("remotes")
remotes::install_github("wjakethompson/measr")
```
Because measr is based on Stan, a C++ compiler is required.
For Windows, the [Rtools program](https://cran.r-project.org/bin/windows/Rtools/) comes with a C++ compiler.
On Mac, it's recommended that you install Xcode.
For additional instructions and help setting up the compilers, see the [RStan installation help page](https://github.com/stan-dev/rstan/wiki/RStan-Getting-Started).
## Usage
We can estimate a DCM using `measr_dcm()`.
This function only requires a data set of item responses and a Q-matrix defining which attributes are measured by each item.
We also identify any respondent or item identifier columns.
Other arguments can be specified to customize the type of model to estimates (see `?measr_dcm()`).
To demonstrate measr's functionality, example data sets are included.
Here we use the Examination of Certificate of Proficiency in English (ECPE; [Templin & Hoffman, 2013](https://doi.org/10.1111/emip.12010)) data (see `?ecpe` for details).
Note that by default, measr uses a full Markov chain Monte Carlo (MCMC) estimation with Stan, which can be time and computationally intensive.
For a quicker estimation, we can use Stan's optimizer instead of MCMC by adding `method = "optim"` to the function call.
However, please not that some functionality will be lost when using the optimizer (e.g., the calculation of relative fit criteria requires the use of MCMC).
```{r est-model, eval = FALSE}
library(measr)
model <- measr_dcm(data = ecpe_data, resp_id = "resp_id",
qmatrix = ecpe_qmatrix, item_id = "item_id")
```
Once a model has been estimated, we can then add and evaluate model fit.
This can done through absolute model fit, relative model fit (information criteria), or reliability indices.
Model parameters, respondent classifications, and results of the model fit analyses can then be extracted using `measr_extract()`.
```{r evl-model, eval = FALSE}
model <- add_fit(model, method = "m2")
model <- add_criterion(model, criterion = "loo")
model <- add_reliability(model)
measr_extract(model, "m2")
#> # A tibble: 1 × 3
#> m2 df pval
#> <dbl> <int> <dbl>
#> 1 506. 325 4.37e-10
```
---
Contributions are welcome.
To ensure a smooth process, please review the [Contributing Guide](https://measr.info/dev/CONTRIBUTING.html).
Please note that the measr project is released with a [Contributor Code of Conduct](https://measr.info/CODE_OF_CONDUCT.html). By contributing to this project, you agree to abide by its terms.