Publicação
Performance evaluation of recent information criteria for selecting multilevel models in Behavioral and Social Sciences
| Resumo: | This study was designed to find the best strategy for selecting the correct multilevel model among several alternatives taking into account variables such as intraclass correlation, number of groups (m), group size (n), or others as parameter values and intercept-slope covariance. First, we examine this question in a simulation study and second, to illustrate the behavior of the criteria and to explore the generalizability of the findings, a previously published educational dataset is analyzed. The results showed that none of the selection criteria behaved correctly under all the conditions or was consistently better than the others. The intraclass correlation somewhat affects the performance of all selection criteria, but the extent of this influence is relatively minor compared to sample size, parameter values, and correlation between random effects. A large number of groups appears more important than a large number of individuals per group in selecting the best model (m >= 50 and n >= 20 is suggested). Finally, model selection tools such as Akaike's Information Criterion (AIC) or the conditional AIC are recommend when it is assumed that random effects are correlated, whereas use of the Schwarz's Bayesian Information Criterion or the consistent AIC are advantageous for uncorrelated random effects. |
|---|---|
| Autores principais: | Vallejo, Guillermo |
| Outros Autores: | Tuero-Herrero, Ellián; Núñez, José Carlos; Rosário, Pedro |
| Assunto: | Model selection Multilevel models Information criteria Monte-Carlo study Ciências Sociais::Psicologia |
| Ano: | 2014 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
article A probabilistic linear solver based on a multilevel Monte Carlo Method
por: Acebron, J. A.
Publicado em: (2020)
por: Acebron, J. A.
Publicado em: (2020)
article A highly parallel algorithm for computing the action of a matrix exponential on a vector based on a multilevel Monte Carlo method
por: Acebron, J. A.
Publicado em: (2020)
por: Acebron, J. A.
Publicado em: (2020)
article Setting up institutions in multilevel states: Assemblies, parties, and the selection of candidates
por: Calca, Patrícia
Publicado em: (2023)
por: Calca, Patrícia
Publicado em: (2023)
article Setting up institutions in multilevel states: Assemblies, parties, and the selection of candidates
por: Calca, P.
Publicado em: (2024)
por: Calca, P.
Publicado em: (2024)
article Joint EURADOS-EANM initiative for an advanced computational framework for the assessment of external dose rates from nuclear medicine patients
por: Struelens, Lara
Publicado em: (2024)
por: Struelens, Lara
Publicado em: (2024)
groups Marx multilevel bipolar modulator dynamic models for load transient analysis
por: Rocha, Luis Lamy
Publicado em: (2017)
por: Rocha, Luis Lamy
Publicado em: (2017)
article A multi-criteria approach for the selection of wastewater treatment systems
por: Goffi, Andreia S.
Publicado em: (2019)
por: Goffi, Andreia S.
Publicado em: (2019)
article The effect of the intramolecular properties in single-carrier polymer diodes
por: Barbosa, Helder M. C.
Publicado em: (2009)
por: Barbosa, Helder M. C.
Publicado em: (2009)
school Criteria in context : understanding the adoption and application of successor criteria in family enterprises
por: Rethmann, Leona Johanna
Publicado em: (2025)
por: Rethmann, Leona Johanna
Publicado em: (2025)
article Implementation of multiple criteria decision analysis approaches in the supplier selection process: a case study
por: Kisly, Dmitry
Publicado em: (2016)
por: Kisly, Dmitry
Publicado em: (2016)
article Selection of the number of components for finite mixtures of linear mixed models
por: Novais, Luísa
Publicado em: (2021)
por: Novais, Luísa
Publicado em: (2021)
article What do europeans believe to be the causes of poverty? A multilevel analysis of heterogeneity within and between countries
por: Costa, L. P.
Publicado em: (2015)
por: Costa, L. P.
Publicado em: (2015)
article Is neglected heterogeneity really an issue in binary and fractional regression models? : A simulation exercise for logit, probit and loglog models
por: Ramalho, Esmeralda A.
Publicado em: (2009)
por: Ramalho, Esmeralda A.
Publicado em: (2009)
article Alternative versions of the reset test for binary response index models : a comparative study
por: Ramalho, Esmeralda A.
Publicado em: (2011)
por: Ramalho, Esmeralda A.
Publicado em: (2011)
article Bulk crosslinking copolymerization: comparison of different modeling approaches
por: Lazzari, Stefano
Publicado em: (2014)
por: Lazzari, Stefano
Publicado em: (2014)
article The influence of nanostructure on polymer-based optoelectronic devices functioning: a computer simulation study
por: Ramos, Marta M. D.
Publicado em: (2011)
por: Ramos, Marta M. D.
Publicado em: (2011)
article A bivariate multilevel analysis of Portuguese students
por: Faria, Susana
Publicado em: (2020)
por: Faria, Susana
Publicado em: (2020)
article Supplier evaluation and selection: a fuzzy novel multi-criteria group decision-making approach
por: Kusi-Sarpong, Simonov
Publicado em: (2018)
por: Kusi-Sarpong, Simonov
Publicado em: (2018)
school Stochastic evaluation of deepwater oil prospects in Portugal using Monte Carlo simulation
por: Camelo, André Rodrigues Seatra
Publicado em: (2014)
por: Camelo, André Rodrigues Seatra
Publicado em: (2014)
school Selecting processes for automation
por: Farinha, Diogo Miguel da Silva
Publicado em: (2021)
por: Farinha, Diogo Miguel da Silva
Publicado em: (2021)
article A Generalized Goodness-of-functional form Test for Binary and Fractional Regression Models
por: Ramalho, Esmeralda A.
Publicado em: (2014)
por: Ramalho, Esmeralda A.
Publicado em: (2014)
article Probabilistic tsunami hazard assessment in meso and macro tidal areas. Application to the Cadiz Bay, Spain
por: Gonzalez, Mauricio
Publicado em: (2021)
por: Gonzalez, Mauricio
Publicado em: (2021)
article Fluid intelligence as a predictor of learning: a longitudinal multilevel approach applied to math
por: Primi, Ricardo
Publicado em: (2010)
por: Primi, Ricardo
Publicado em: (2010)
article Perceptions of poverty attributions in Europe: a multilevel mixture model approach
por: Costa, L. P.
Publicado em: (2014)
por: Costa, L. P.
Publicado em: (2014)
article Disentangling the relation between wealth and contraceptive use in India: a multilevel probit regression approach
por: Oliveira, I.
Publicado em: (2014)
por: Oliveira, I.
Publicado em: (2014)
article A Monte Carlo simulation-based approach to solve dynamic sectorization problem
por: Teymourifar, Aydin
Publicado em: (2021)
por: Teymourifar, Aydin
Publicado em: (2021)
article Ultrafiltration of supercoiled plasmid DNA : modeling and application
por: Morão, A.
Publicado em: (2011)
por: Morão, A.
Publicado em: (2011)
school A comparative evaluation of VaR models using Monte Carlo simulations
por: Gomes, Diogo Filipe Meireles
Publicado em: (2020)
por: Gomes, Diogo Filipe Meireles
Publicado em: (2020)
article Nonmonotonic Magnetic Susceptibility of Dipolar Hard-Spheres at Low Temperature and Density
por: Kantorovich, Sofia S.
Publicado em: (2013)
por: Kantorovich, Sofia S.
Publicado em: (2013)
article Development of a Modular Multilevel Cascade Converter based on full-bridge submodules with a common DC Bus
por: Rego, João
Publicado em: (2022)
por: Rego, João
Publicado em: (2022)
article A new regression-based tail index estimator
por: Nicolau, João
Publicado em: (2019)
por: Nicolau, João
Publicado em: (2019)
article Communication: The criticality of self-assembled rigid rods on triangular lattices
por: Almarza, N. G.
Publicado em: (2011)
por: Almarza, N. G.
Publicado em: (2011)
article Multi-criteria methodology for selection of wastewater treatment systems with economic, social, technical and environmental aspects
por: Lizot, Mauro
Publicado em: (2021)
por: Lizot, Mauro
Publicado em: (2021)
groups A multilevel topology based on the T-Type converter for SRM drives
por: Fernao Pires, Vitor
Publicado em: (2018)
por: Fernao Pires, Vitor
Publicado em: (2018)
school Cálculo dos Gregos em modelos de volatilidade estocástica através do cálculo de Malliavin e simulação de Monte Carlo
por: Correia, Miguel Vieira Pacheco
Publicado em: (2024)
por: Correia, Miguel Vieira Pacheco
Publicado em: (2024)
article A discussion on indicators and criteria for sustainable urban infrastructure development
por: Danko, Cristina Carvalho
Publicado em: (2007)
por: Danko, Cristina Carvalho
Publicado em: (2007)
book Efficient quadrature rules for illumination integrals: From quasi Monte Carlo to bayesian Monte Carlo
por: Marques, Ricardo
Publicado em: (2015)
por: Marques, Ricardo
Publicado em: (2015)
article A multi-criteria approach to decision making in broadband technology selection
por: Araújo, Marco
Publicado em: (2022)
por: Araújo, Marco
Publicado em: (2022)
article Application of GIS-based multi-criteria analysis for site selection of aquifer recharge with reclaimed water
por: Pedrero Salcedo, Francisco
Publicado em: (2011)
por: Pedrero Salcedo, Francisco
Publicado em: (2011)
draft Tests for the null hypothesis of cointegration: a Monte Carlo comparison
por: Gabriel, Vasco J.
Publicado em: (2001)
por: Gabriel, Vasco J.
Publicado em: (2001)
Registos relacionados
-
article A probabilistic linear solver based on a multilevel Monte Carlo Method
por: Acebron, J. A.
Publicado em: (2020) -
article A highly parallel algorithm for computing the action of a matrix exponential on a vector based on a multilevel Monte Carlo method
por: Acebron, J. A.
Publicado em: (2020) -
article Setting up institutions in multilevel states: Assemblies, parties, and the selection of candidates
por: Calca, Patrícia
Publicado em: (2023) -
article Setting up institutions in multilevel states: Assemblies, parties, and the selection of candidates
por: Calca, P.
Publicado em: (2024) -
article Joint EURADOS-EANM initiative for an advanced computational framework for the assessment of external dose rates from nuclear medicine patients
por: Struelens, Lara
Publicado em: (2024)