LAUSR

Recently, bifactor modeling applications in clinical measurement have proliferated (e.g., Caspi et al., 2014; Lahey et al., 2012; Simms, Grös, Watson, & O’Hara, 2008; Vanheule, Desmet, Groenvynck, Rosseel, & Fontaine, 2008). It is critical, however, to distinguish between two types of applications. The first focuses on using the bifactor model as a tool for understanding the psychometrics of an assessment scale (see Rodriguez, Reise, & Haviland, 2016a, 2016b). This type has proven invaluable for informing the degree to which a measure yields an univocal total score (Reise, Moore, & Haviland, 2010) and, relatedly, the extent to which subscales representing theoretically distinct constructs (i.e., group factors) yield reliable scores after accounting for the general factor (Reise, Bonifay, & Haviland, 2013). The second is far more ambitious and leverages a bifactor model to represent the general and group factor structure of an entire domain of psychological functioning. This is the type in question in the target article ( Snyder, Young, & Hankin, 2016, this issue), wherein correlations among psychopathology items are modeled as reflecting a single psychopathology dimension, p, as well as orthogonal internalizing/externalizing group factors. In this and related studies, it is the structure, rather than the psychometric properties, that is of paramount theoretical interest. We raise three issues with bifactor modeling as it is applied to the “structure of psychopathology”— interpretability, model fit, and validation—and we point to recent psychometric tools for bifactor model evaluation. In the initial development of the bifactor method, Holzinger and Swineford (1937) stated that group factors are derived from the residual correlations that remain after extracting the general factor. Although estimation methods have changed radically since 1937, interpretation of group factors that are orthogonal to a general factor remains challenging. In certain applications (e.g., Cho, Cohen, & Kim, 2014), group factors are not viewed as meaningful subconstructs of a test but rather as methodological “nuisances” that impede measurement of the primary construct of interest. Assuming, however, that group factors are meaningful, how should they be interpreted? They must be construed as substantively unique, measuring subconstructs exclusive to the general factor. Snyder et al. (2016, this issue) and others conclude that the structure of psychopathology includes internalizing/ externalizing group factors; it is unclear whether, or to what degree, these factors can be interpreted as traits orthogonal to the p factor. It may also be difficult to interpret the general dimension in a bifactor model. Previous research has noted that a positive manifold does not imply a single general causal structure (e.g., a single neuropsychobiological structure that causes variation across content-diverse indicators; van der Maas et al., 2006). Although strong correlations among measures may suggest a bifactor structure, that does not imply that such a structure exists at the genotypic level (e.g., Cohen, Cohen, Teresi, Marchi, & Velez, 1990). Thus, it could be that the internalizing/ externalizing factors identified by Snyder et al. (2016, this issue) are interpreted correctly but that the emergence of a general p factor, rather than being generated by a single general latent trait, is the result of some different process altogether. Researchers must carefully investigate such issues before considering the bifactor model seriously as a foundational structure for clinical research. Of particular concern is the bifactor model’s tendency to show superior goodness of fit in model comparison studies. In Snyder et al. (2016, this issue), the bifactor structure outperformed both the unidimensional and the two (correlated) factor alternatives regarding goodness of fit and was thereby selected as the best representation of psychopathology. However, the superior performance of the bifactor model may be a symptom of “overfitting”— that is, modeling not only the important trends in the 657069 CPXXXX10.1177/2167702616657069Bonifay et al.Bifactor Model as a Structure of Psychopathology research-article2016